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OVER- AND UNDERACHIEVEMENT, AND RELATED 
PERSONALITY VARIABLES 
JAMES V. MITCHELL, JR. 

University of Texas 


It has never been doubted that goal- 
setting behavior is strongly influenced by 
the organization of personality, and sev- 
eral investigators have attempted to ferret 
out the significant variables of personality 
that are the major determinants of goal- 
setting behavior (Cohen, 1954; Frank, 
1935; Gardner, 1940; Gould & Kaplan, 
1940; Gruen, 1945; Sears, 1941). This has 
not always been an easy task, and it be- 
comes clear to most that the actions and 
interactions of variables influencing goal- 
setting are quite complex and not always 
subject to simple explanations. In the pres- 
ent study it was not the author’s purpose 
to identify all of the personality variables 
that influence goal-setting behavior, but 
rather to analyze the’ patterns of goal- 
setting behavior and related personality 
characteristics of groups that were sys- 
tematically varied with respect to the two 
variables of self-acceptance and under- 
and overachievement. 

PROCEDURE 
Subjects 

Ss were 100 female college students who 
were majoring in elementary and second- 
ary education and who were either fresh- 
men or sophomores at the time of the 
investigation. 


Measures 
The goal-setting behavior of these Ss 
was studied in the aetual classroom situa- 


tion. Ss were all members of the author's 
televised course in elementary educational 
psychology and hence received exactly the 
same instruction, except for short discus- 
sion periods led by graduate assistants 
(Miami University, 1957; Mitchell, 1958). 
Objective examinations were administered 
at the end of the fifth, eleventh, and six- 
teenth weeks, and immediately before each 
examination the subjects were asked the 
following questions in the order indicated: 
(a) What grade can you reasonably hope 
to attain on this examination? (b) What 
grade do you actually expect to get? 

At the very beginning of the course the 
Ss had been asked the same questions for 
the entire course, and this was also avail- 
able for analysis. Also recorded for each 
S was the actual grade received on each 
examination and for the course as a whole. 
Ss were allowed to use “+” and “—” in 
setting their goals, and values from zero 
through nine were assigned to the letter 
grades A and higher, B+, B, B—, C+, C, 
C-—, D+, D & D-—, and F respectively, 
the lower values being assigned to the 
higher grades. With these numerical con- 
versions one could represent the difference 
between an S’s level of aspiration and 
actual grade obtained by subtracting the 
corresponding value of her actual grade 
from the value for her level of aspiration, 
eg., LA = B or 2; actual grade = C— 
or 4; difference = —2. Other operations 
similar to this were also performed. In 
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computing grades for the course the au- 
thor made certain that the proportions 
of Ss receiving grades in each of the ten 
categories described above were the same 
for every examination, thus keeping this 
factor constant throughout the entire 
course. Both grades and aspiration esti- 
mates had reasonably normal distributions 
for each examination, although the means 
of the aspiration estimates, of course, were 
consistently higher than the comparable 
means of the actual grades obtained. 

“Self-Acceptance” was measured by 
means of Bills’ Index of Adjustment and 
Values (Bills, 1951; Bills, 1953). The 
original Index consists of 49 adjectives, 
and for each of these the S is to rate him- 
self on a five point scale with respect to 
(a) how much of the time the trait is 
characteristic of him (e.g., “optimistic”), 
(6) how the S “feels about” himself as 
described in the first operation (ie., I 
...[l}—very much dislike . . . [2]—dislike 
...[3]—neither dislike nor like... 
like... [5}—like very much... being as 
I am in this respect), (c) how much of 
the time the S would like to have more 
of the trait in question (again on a five- 
point continuum). To this original Index 
were added three new adjectives related to 
desire to achieve: “industrious,” “hard- 
working,” and “motivated.” 

In computing an index of under- and 
overachievement the ACE scores for all 
Ss were normalized and then converted 
to standard score form. The numerical 
grade average for each S for the semester 
in which the study was conducted was 
also computed, and these were also nor- 
malized and converted into standard score 
form. The index of under- and over- 
achievement for each S was then defined 
as the S’s Z score for her semester grade 
average minus her Z score for her ACE 
performance. 

To analyze the related personality char- 
acteristics of the variables described above, 
a personality inventory was administered 
that included all of the items of the Taylor 


Manifest Anxiety Scale (Holtzman, 1952; 
Taylor, 1953), some additional MMPI 
items concerned with general metal health, 
and some items of the author’s own devis- 
ing that were related to the student’s de- 
sire to achieve. 
Design 

A preliminary analysis of data in which 
the Bills’ “self-acceptance” scores were 
plotted against the indices of under- and 
overachievement yielded a nonsignificant 
correlation close to zero but revealed a 
“butterfly” configuration with significantly 
greater variability in achievement-intelli- 
gence ratios for the “self-acceptant” and 
“self-rejectant” extremes of the Bills’ scale 
than for the moderately acceptant middle 
values. On the basis of these findings it 
was hypothesized that the underachievers 
and overachievers at either end of the 
Bills’ scale were psychologically distinct 
groups that would exhibit different kinds 
of goal-setting behavior and different kinds 
of related personality characteristics. 

A “self-acceptant” group (NV = 60) and 
a “self-rejectant” group (NV = 40) were 
then selected from either extreme of the 
Bills’ distribution on the basis of observ- 
able differences in variability between 
them and the more constricted middle 
group, and only these extreme groups were 
used in the major analysis. Ss in the “self- 
acceptant” group had total scores of 170 
and above on the Bills’ “self-acceptance” 
scale, while the “self-rejectant” group had 
total scores of 149 and below. Both of 
these groups were further subdivided into 
“overachievers” and “underachievers,” 
with those having positive index values 
assigned to the former group and those 
with negative index values assigned to the 
latter. There were thus four separate 
groups subject to the analysis: (a) the 
self-acceptant underachievers (NV = 31), 
(b) the self-acceptant overachievers (V = 
29), (c) the self-rejectant underachievers 
(N = 16), and (d) the self-rejectant over- 
achievers (NV = 24). The median ACE 
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percentile ranks for each group, based 
upon the national norms, were 70, 55, 79, 
and 35, respectively. A two-way analysis 
of variance with unweighted means was 
applied to the normalized Z scores of 
the ACE and yielded an F of 86 (N. 8S.) 
between the self-acceptant and _ self-re- 
jectant groups and an F of 21.95 between 
the underachievers and overachievers, an 
expected difference which was significant 
(p < 001). The numerical grade point 
averages for the semester in which the 
study was conducted, based upon a con- 
version system for which A = 4, B = 3, 
C = 2, etec., were 2.14, 2.92, 2.34, and 
2.73, respectively. When the same analy- 
sis of variance technique was applied to 
these grade data, the resultant F of .01 be- 
tween the self-acceptant and self-rejectant 
groups was not significant, while the F 
between the underachievers and over- 
achievers was 26.50, another expected dif- 
ference that was significant (p < .001). 
Interactions for both the ACE and the 
grade point averages were insignificant. 

For each of the four subgroups of the 
study the following goal-setting data were 
secured: 


1. Mean level of aspiration (LA) for each 
examination (from responses to “What grade 
can you reasonably hope to attain on this 
examination?”). 

2. Percentages of students actually achiev- 
ing their levels of aspiration for each exami- 
nation. 

3. Mean grade expectancy (Gr. Exp.) for 
each examination (from responses to “What 
grade do you actually expect to get on this 
examination?”). 

4. Mean of the differences between each 
S's level of aspiration and her expected grade 
(i.e., LA — Gr. Exp.) for each examination. 

5. Mean of the differences between each 
S’s level of aspiration and her actual grade 
obtained (ie, LA — Gr.) for each exami- 
nation. 

6. Mean of the differences between each 
S’s expected grade and her actual grade ob- 
tained (i.e., Gr. Exp. — Gr.) for each exami- 
nation. 

7. Mean of the differences between each 
S’s actual grade obtained on the last exami- 


nation and her level of aspiration for the 
next examination (i.e., Gra — LAs: and Grs — 
LAs). 

8. Mean level of aspiration for the course 
as a whole, taken at the very beginning of 
the course (LA.). 

9. Mean of the differences between each 
S’s level of aspiration for the course and the 
final grade received for the course (i.e., LA. 
— Fin. Gr.). 

10. Percentages of students actually 
achieving their levels of aspiration for the 
course as a whole. 


All four subgroups were also compared 
with respect to their performance on the 
personality inventory and the self-de- 
scriptive section of the Bills’ scale. In the 
former case the percentages of Ss _re- 
sponding “Yes” to each item were com- 
puted for each group. Items showing large 
intergroup differences were subject to 
tests of significance and further analysis. 
In the latter case, choices for the self- 
descriptive operation were dichotomized 
into two groups, with choices 1-Seldom 
is this like me, 2-Occasionally this is like 
me, and 3-About half of the time this is 
like me being placed in the one group; and 
choices 4-A good deal of the time this is 
like me, and 5-Most of the time this is 
like me being placed in the other group. 
Percentages of Ss in each of these two cate- 
gories were computed for the four sepa- 
rate subgroups. Items showing large inter- 
group differences were subject to tests of 
significance and further analysis. 


REsuULTs 


Table 1 reveals the goal-setting charac- 
teristics of the four subgroups. The num- 
bered subscripts 1, 2, and 3 refer to the 
first, second, and third examinations of 
the course, while the letter subscript “ec” 
refers to aspiration estimates or grades for 
the course as a whole. A two-way analysis 
of variance was employed for all compari- 
sons, using the method of unweighted 
means as described by Snedecor (1956, p. 
385). Interaction effects were omitted 
from the table, since the only significant 
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interaction was that for LA,, which had 
an F of 4.30 (p < .05). Since some pre- 
vious studies indicated the possibility of 
significant differences in LA variances be- 
tween the self-acceptant and self-rejectant 
groups and between the underachieving 
and overachieving groups, the F test was 
applied for both of these comparisons for 
LA, , LA,, LA., LA, — Gr. , LA. — Gre, 
LA, — Gr. , Gr., — LA,, and Gr. — LA,. 
With but one exception no significant dif- 
ferences in variances appeared for any of 
these comparisons. The one exception in- 
volved LA, , where it appeared that over- 
achievers were significantly (p < .05) 
more variable in setting their first level of 
aspiration than underachievers. 

Inspection of Table 1 discloses some in- 
teresting differences in goal-setting be- 
havior for the four subgroups. Within the 
LA — Gr. category it can be observed that 
the overachievers come significantly closer 
to their level of aspiration than the under- 
achievers for Exams 1 and 3, for the Total 
LA — Gr. averages, and for the course as 
a whole, and that on Exam 3 the self-re- 
jectant group comes significantly closer to 
their level of aspiration than the self- 
acceptant group. Although the latter trend 
is observable for Exams 1 and 2 as well, 
it is not statistically significant for these 
exams, a circumstance which can probably 
be related to the considerable discrepancy 
in LA — Gr. for the self-rejectant under- 
achiever in the early part of the semester 
and the subsequent progressive decrease 
in LA — Gr. discrepancy toward the end 
of the semester. This progressive decrease 
is, in turn, probably attributable to the 
fact that the self-rejectant underachiever 
readjusts her LA downward relatively 
more often and more severely than the 
others during the semester, as can be ob- 
served from the LA data. This is in 
contrast to the expected grades, which re- 
main fairly constant throughout the semes- 
ter for all groups. 

Differences between the goal-setting be- 
haviors of the sef-acceptant and self-re- 
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jectant groups are even more clearly re- 
vealed for the Gr. Exp. — Gr. data. Here 
it is evident that the actual exam grades 
obtained are consistently lower than the 
expected grades for the self-acceptant 
groups, while the self-rejectant groups 
either have less of a negative discrepancy 
or actually obtain grades higher than ex- 
pected, a difference which is significant at 
the .05 level for Exams 2 and 3 and for 
the Total Gr. Exp. — Gr. averages. It is 
also interesting to note that the order of 
magnitude of the Gr. Exp. — Gr. discrep- 
ancies is always the same: self-acceptant 
underachiever (greatest), self-acceptant 
overachiever, self-rejectant underachiever, 
and self-rejectant overachiever (least). 

Some other interesting differences are 
revealed by the Gr. — LA data. The dis- 
crepancy between present level of aspira- 
tion and previous grade obtained is sig- 
nificantly higher for the underachievers 
for Gr. — LA,. When next computed, 
however, the picture is somewhat different, 
for with Gr, — LA, the self-rejectant 
group now has a significantly smaller dis- 
crepancy between present LA and previ- 
ous grade than the self-acceptant group. 
Both trends are present for both sets of 
data, but each attains statistical signifi- 
cance only once. The reason for this can 
be traced to the behavior of the self-re- 
jectant underachievers and the self-ac- 
ceptant overachievers. The self-rejectant 
underachievers are the only ones for whom 
the Gr. — LA, discrepancy is less than 
the Gr., — LA, discrepancy, despite the 
fact that they shared with others an ap- 
preciable increase in percentage of LAs 
obtained from LA, to LA, . Quite in con- 
trast is the considerable increase from 
Gr., — LA, to Gr. — LA, for the self- 
acceptant overachievers. These two 
changes are sufficient to change the pic- 
ture of statistical significance. 

Inspection of Table 1 also discloses the 
following additional information: 


1. There is a general trend for LAs to be 
lower than LA;, probably as a result of the 
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TABLE 1 


CoMPARISONS OF THE GoaL-SeTTING BeHAvioR OF SELF-ACCEPTANT UNDERACHIEVERS, 
OVERACHIEVERS, SELF-ReJEcTANT UNDERACHIEVERS, AND 
OvVERACHIEVERS 


Self-Rejectant 
| F for Self- | F for Under- 
| Acceptance and Over- 

Under- Over- | Under- Over- and Rejection Achievement 
Achievers | Achievers | Achievers | Achievers | 


Self-Acceptant 


LA. 7 oom |) |) «1.85 | 1.99 


LA, 
LA: 
LA; 


LA; — Gr. Exp. 
LA: — Gr. Exp.: 
LA; — Gr. 


LA; 

LA; Gr... 

LA; 

Total LA — Gr. 
(Exams 1 + 2 + 3) 


LA, — Fin. Gr. 


% Achieving LA; 
% Achieving LA; 
% Achieving LA; 


% Achieving LA. 


Gr. Exp. — Gr. —1.20 
Gr. Exp.: — Gr.: — .57 
Gr. Exp.s — Gr.s —1.37 
Total Gr. Exp. — Gr. —3.14 

(Exams 1 + 2 + 3) 


Gr. — LA: 1.93 1. 78 | 
— LAs 2.17 1. 87 | 


Final Grade | 4.93 2.50 4.46 2.91 


Note.— Numerical subscripts 1, 2, and 3 refer to the Ist, 2nd, and 3rd examinations of the course; letter subscript 
“ec” refers to the course as a whole. 
* Key to abbreviations used: 
LA: Level of Aspiration 
Gr. Exp.: Grade Expectancy 
Gr.: Grade actually obtained 
Fin. Gr.: Final Grade in course 
* Significant at .05 level. 
** Significant at .01 level. 


niggardly proportion of Ss attaining LA:. exception already noted is that for the self- 
This is followed by an increase in the per- _rejectant underachiever.) 

centages of Ss attaining LAs, which is fol- 2. The level of aspiration for the course is 
lowed in turn by an increase in LAs. (An always higher than LA;, even though no 


if 
: 
| 2.73 | 1.54 | 2.97 2.43 | 4 (2.51 
3.13 | 1.82 3.00 2.70 91 | 4.21° i 
2.57 | 1.39 3.07 2.22 | 1.79 4.18* 7 
—1.13 —.75 | —2.13 | —1.04 | 6.40° | 8.31°* 
—1.03 | -1.14 | -1.87 | -1.17 | 3.25 | 1.50 
—1.10 —.89 | —1.33 -.91 | .31 | 1.99 
-2.33 | -1.96 | -2.47 | -1.06 | | 7.32% 
" -1.60 | -1.32 | -1.60 | -.39 | 1.02 | 2.62 
—2.47 | —1.21 —1.33 —.70 | 5.02* | 6.59° 
—6.40 | -3.89 | -5.40 | -2.13 | 2.35 | 11.86* 
| 
-3.77 | -1.79 | -3.33 | -1.57 | .80 | 25.56°° 
; 13 43 7 35 | | = 
i 33 36 47 a7 ; 
0 25 7 30 
—.61 00 | 2.81 | 1.08 
-.18 27 78 | 1.08 
j —.32 .00 2 | 5.91% | 2.61 
-1.11 | —.06 1.00 | 8.71% | 2.90 
| 
i 32 4.31* 
\ 4.12* | 2.08 
| 19.81** | 
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formal evaluation has occurred in the mean- 
time. Aparently just a few weeks of course 
work encourages more realistic goal-setting. 

3. The self-rejectant overachievers always 
have the least discrepancy between level of 
aspiration and grade actually obtained. 

4. The self-rejectant overachievers are 
consistently most likely to receive an exam 
grade that fulfils or surpasses their stated 
expectations. 

5. The self-rejectant overachievers always 
have the least discrepancy between previous 
grade and present level of aspiration (which 
partially explains 3 and 4 above). 

6. The self-acceptant underachievers al- 
ways have the greatest discrepancy between 
previous grade and present level of aspira- 
tion. 

7. The self-acceptant underachievers al- 
ways have the greatest discrepancy between 
expected grade and grade actually obtained. 

8. For the first exam the discrepancy be- 
tween level of aspiration and grade expect- 
ancy is significantly greater for the under- 
achievers as opposed to the overachievers 
and significantly greater for the self-rejectant 
as opposed to the self-acceptant. Though 
these trends are observable again for the 
second and third exams, they are not sig- 
nificant for these, primarily because of the 
progressive decrease in LA — Gr. Exp. dis- 
crepancy for the self-rejectant under- 
achievers. The latter, however, are observed 
to have the greatest discrepancy for all three 
exams, despite this progressive decrease. 


Tables 2, 3, and 4 show some of the 
personality characteristics associated with 
membership in each of the four separate 


TABLE 2 
Scores ON THE TAYLOR MANIFEST 
ANxIETY SCALE FOR THE Four 
SuBGROUPS 
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| 


F be! for F Test for 


Under- and 


| 
Self- 
Self-Acceptant Se | Ac | Over- 
| Rejectant and | Achieve- 
| Rejection | ment 


Note.—The interaction effect was insignificant and 
therefore omitted. 


subgroups. Table 2 indicates that scores 
on the Taylor Manifest Anxiety Scale 
were significantly higher for the self-re- 
jectant Ss as opposed to the self-acceptant 
Ss and for the overachievers as opposed 
to the underachievers. The cumulative ef- 
fect of these two trends is to reveal the 
self-rejectant overachiever as the highest- 
ranking on the anxiety scale and the self- 
acceptant underachiever as the lowest. It 
is interesting to note that the order of 
magnitude for these scores is exactly the 
same as that for the Gr. Exp. — Gr. data 
for all three exams, and also for the Gr. — 
LA, data as well. 

Table 3 shows those items in the per- 
sonality inventory that produced statisti- 
cally significant discriminations among the 
four subgroups of the study. For each of 
these items the numbers of Ss answering 
“Yes” and “No” were computed for each 
subgroup, and a chi square value was 
computed for the resulting 2 by 4 table. 
Table 4 shows those items in Bills’ Index 
of Adjustment and Values that produced 
statistically significant discriminations. 
These same operations had been carried 
out for the Bills’ scale, the responses being 
dichotomized as described in a previous 
section. However, certain problems arose 
with the Bills’ scale that necessitated a 
somewhat different type of analysis. It 
was evident that statistically significant 
differences would appear for items on the 
Bills’ scale by virtue of the fact that the 
self-acceptant Ss would naturally rate 
themselves higher on positive traits than 
would the self-rejectant Ss. The same 
trend is also observable for the data of 
Table 3, but here the effect does not seem 
to be as great. But for the Bills’ scale it 
was decided to rank the items within each 
group according to the percentage of posi- 
tive responses (Alternatives 4 & 5) and 
then to add these rank order data to the 
table for interpretive purposes. The 
ranked data constitute a self-representa- 
tion by each group in terms of characteris- 
ties seen as more typical or less typical of 
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TABLE 3 
INVENTORY Irems Havine Sicniricant Cat Square VALUES FoR THE Four SusGroups 


Percentage Answering “Yes” 


Self-Acceptant Self-Rejectant 


Under- Over- Under- Over- 
Achievers | Achievers | Achievers | Achievers 


When I’m faced with difficult task 
I generally ‘“‘give up’’ too easily. 10 17 
I wish I were more successful as a 
student. 90 92 
I try to do well in anything I un- 
dertake. 97 92 
I am more sensitive than most 
other people. 20 58 
frequently find myself worrying 
about something. 47 
find the standards I set for my 
own work are usually too high for 
me to attain. 40 
wish I could be as happy as others 
seem to be 16 
am usually calm and not easily 
upset. 97 
usually expect to succeed in 
things I do. 87 
have periods of such great rest- 
lessness that I cannot sit long in | 
a chair. 30 §.48* 
have sometimes felt that diffi- 
culties were piling up so high 
that I could not overcome them. 8.39* 
I find it hard to keep my mind on 
a task or job. 17.09** 
I am a high-strung person. 13.26** 
Life is a strain for me much of the 
time. 
I have strong motivation to suc- 
ceed in my work. 
At times I think I am no good at 
all. 


14.74°* 


12.09** 


18.00** 

I am certainly lacking in self- 
confidence. 

I am entirely self-confident. 

I brood a good deal. 

I’ll never be able to live up to my | 
parents’ expectations for me. 

I am liked by most people who | 
know me. 80 


| 21.05** 
12.52°* 
| 
| 


8.34* 


| 9.61° 
| 


88 7.13" 


* Approaches statistical significance where p.os = 7.82; included here for its interpretive value in discriminating 
the subgroups 

* Significant at .05 level. 

** Significant at .01 level. 
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them as individual members of the group. teresting differences between the four 
Three of the traits—‘optimistic,” “stub- subgroups. The self-acceptant under- 


born,” and “competitive’—were included achiever rates herself higher than the 
; in Table 4 despite the fact that they were others on such traits as happiness, self- 
ys not statistically significant, because it was confidence, alertness, being less sensitive 
, anticipated that these three would exhibit than others, worrying less, being calm and 
appreciable intergroup differences in rank not high-strung or easily upset, and not 
7 even though statistical signifieance was ab- _ finding life much of a strain. But she rates 
sent. This proved to be the case for two _ herself low on ambition. The self-accept- 
" of these three traits. ant overachiever rates herself high on ma- 
: Inspection of Table 3 along with the  turity, worthiness, competence, and in- 
ranked data of Table 4 discloses some in- dustry, considers herself well-liked, and 
ee. TABLE 4 
f IreMs IN THE “INDEX OF ADJUSTMENT AND VALUES’’ HAVING SIGNIFICANT Cut SQUARE 
VALUES FOR THE FouR SUBGROUPS 
| Item Rank Within Group 


| 


Self-Rejectant 


Item | Self-Acceptant Self-Rejectant x? Self-Acceptant 

acceptable | 100 | 90 87 | 46 |20.55°| 1 | 5 1 9 
alert 90 72 25 | 37 | 27.30*%*| 5 14 15.5 | 14 
ambitious | 56 79 31 58 | 11.58** | 20 13 11.5 | 4 
calm | 81 69 62 37 13.28** | 9 15 3.5 | 14 
competent | 81 86 31 37 «| :19.34°* 9 7.5 11.5 | 14 
confident | 81 66 19 12 | 34.15**/ 9 | 16.5 | 19.5 | 23 
helpful | 81 93 50 | 54 |15.48%*/ 9 | 3 5.5 | 6.5 
logical | 77 66 25 42 | 14.22°*| 12.5 | 16.5 | 15.5 | 11 
industrious | 58 86 25 33 | 19.47** | 18.6 | 7.5 15.5 | 17 
merry | 90 86 62 58 | 11.12* Ss f gs 3.5 | 4 
mature 90 97 37 36.62*| 5 | 1 8.5 | 14 
nervous | 10 14 19 37 7.60" | 23.5 | 24 19.5 | 14 
optimistic | 61 2 50 29 | 6.00 | 16.5 | 19.5 | 5.5 | 19 
poised | 71 62 37 29 | 11.99°* | 14.5 | 19.5 8.5 | 19 
responsible | 42 59 12 8 | 19.05** | 21.5 | 22 22.5 | 24 
hardwork- | 

ing «61 83 19 46 | 18.86** | 16.5 | 10.5 | 19.5 | 9 
stable 93 83 44 67 | 16.23**| 2.5 | 10.5 7 1 
studious 42 62 6 46 | 13.21** 21.5 19.5 24 9 
successful | 71 81 31 21 | 21.17** | 14.5 | 12 11.5 | 21.5 
stubborn | 10 17 19 | 21 1.64 23.5 | 23 19.5 | 21.5 
worthy 77 93 31 29 | 32.74** | 12.5 3 11.5 119 
broad- | | 
minded 93 93 69 62 | 13.31% | 25] 3 | 2 2 

competitive 58 62 25 58 | 6.56 | 18.5 | 19.5 15.5 4 
motivated s1 | 86 12 | 54 | 29.60%| 9 | 7.5 | 22.5 | 6.5 


* Approaches statistical significance where p.os = 7.82; included here for its interpretive value in discriminating 
the subgroups 

* Significant at .05 level. 
** Significant at .01 level. 
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rates herself extremely high on her ex- 
pectancy “to succeed in things I do.” The 
self-rejectant underachiever rates herself 
low on motivation and high on “giving up” 
too easily. She is more likely to report that 
she is not studious or “hardworking.” She 
is also more likely to report that she finds 
it hard to keep her mind on a task and 
that at times she thinks she is no good at 
all. In spite of this she ranks calmness 
and optimism high in her self-ratings. The 
self-rejectant overachiever rates herself 
high on ambition, motivation in school- 
work, studiousness, competitiveness, nerv- 
ousness, sensitivity, and tendency to brood 
or worry. She rates herself low on confi- 
dence, competence, success, acceptability, 
maturity, and worthiness. She is also more 
likely to report unhappiness, being high- 
strung and easily upset, feeling over- 
whelmed with difficulties, setting standards 
too high to attain, not expecting to succeed 
in things she does, and finding life a strain 
much of the time.’ 

After the data of Table 4 had been 
ranked to facilitate interpretation, it 
seemed fruitful to take one further step 
and compute intergroup rank-difference 
correlations to determine the degree of 
similarity and difference between the rank- 
ings of the various groups. These data are 
shown in Table 5. One notable difference 
here is that the self-rejectant overachiever 
is Jeast similar to all the others for these 
selected traits. The traits which serve most 
to distinguish her from the others appear 
to be the following: strong competitive- 
ness, ambition, studiousness, feelings of 
unworthiness, acknowledged immaturity, 
extreme lack of self-confidence, lack of 
success feelings, and nervousness and anxi- 


‘Tt is curious that the self-rejectant over- 
achiever regards stability as the trait most 
characteristic of herself, and one suspects 
that the term is so emotionally loaded that 
it activates the strongest defensive reactions 
in those who are the most unstable. It is 
also sufficiently nondescriptive to encourage 
unthinking (and generally positive) re- 


sponses. 


TABLE 5 


INTERGROUP CORRELATIONS FOR THE 
RANKED Data or TaBLe 4 


Self Self- 
Acceptant | Rejectant 


| 


Achievers 
Achievers 
Achievers 


Over 
Under 
Over- 


Self-Ac- Under- 
ceptant | Achievers 

| Over- 

| Achievers 


| Under- 
Achievers 
Over- 
Achievers 


Self-Re- 
jectant 


ety. These data should be considered in 
the light of the fact that the self-rejectant 
overachievers are definitely a below aver- 
age group intellectually, having a median 
ACE percentile rank of only 35. 


Discussion 


Data have been presented concerning 
the goal-setting patterns of the four sub- 
groups and also the personality charac- 
teristics distinguishing the subgroups. An 
attempt will now be made to interpret 
these empirical relationships and portray 
their meaning for each of the groups in- 
volved. 

Some significant trends are evident for 
the data as a whole. By inspection it is 
evident that self-rejection and manifest 
anxiety are related. (An earlier investiga- 
tion revealed a significant correlation of 
Al between these two variables.) Both of 
these are related in turn to a cautious and 
conservative pattern of goal-setting, the 
most anxious, setting 
their new LAs closest to the grades ob- 
tained on the previous exam. It is prob- 
these Ss more 


self-rejectant Ss 


ably because of this that 
often exceed their stated grade expecta- 
tions than is typical of the less anxious, 
whose actual 


self-acceptant subjects, 
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grades are characteristically lower than 
their stated grade expectations. One ex- 
planation for this is that the self-rejectant 
person tends to be relatively unconfident 
and pessimistic when predicting her grade, 
and she is so conservative in her predic- 
tions that she often performs better than 
she expects. The self-acceptant person, on 
the other hand, may expect more and 
generally get less. An alternative but re- 
lated explanation would be that the al- 
ready anxious, self-rejectant person is 
consciously or unconsciously aware that 
critical nonattainment of goals would 
create additional tension and anxiety with 
which she could not cope, and to prevent 
this from occurring she lowers her aspira- 
tions accordingly. It is probable that both 
of these operate in some measure. 
Operating within this general trend are 
several specific tendencies that can be 
noted for each of the separate subgroups: 


The Self-Acceptant Underachiever: There 
is a strong suggestion in the data that he 
self-acceptant underachiever either fulfils 
her ego needs in areas other than the aca- 
demic or that she can somehow achieve self- 
satisfaction and contentment more easily 
(and with less justification) than the average 
person. Her calm, unworried, self-confident 
kind of temperament permits her to aspire 
to grades that are further beyond actual 
previous attainmeni than those for any other 
group. However, she is not especially am- 
bitious or willing to exert much effort in 
order to achieve her goals, sud she therefore 
also falls further short of her expectations 
than those in any other group. She often 
recognizes that she has not attained the 
standards she set for herself, but, nonattain- 
ment is apparently of little concern to her, 
since she is the least anxious of all those 
represented in the study. Doubtlessly she is 
well-adjusted, but she falls far sl.ort of realiz- 
ing her potentialities as an individual. 

The Self-Acceptant Overachiever: The 
self-acceptant overachiever can probably 
best be characterized as the well-adjusted, 
“good” student. Although often of mediocre 
intelligence, she consistently aspires to the 
highest grades, and her actual grades are 
generally the highest obtained by any of the 
subgroups. She is a hard working, industrious 
person whose diligence has assured success 
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in the past and who therefore just expects 
further success in the future. She probably 
obtains a large measure of ego-satisfaction 
through her academic work. She can put 
pressure on herself when she needs it most; 
toward the end of the course she considerably 
increased the gap between the last exam 
grade and her current LA and then went on 
to come as close or closer to this new aspi- 
ration than she ever had before. She sees 
herself as a mature, worthy, well-liked per- 
son who is competent to deal with life's 
challenges and can do so without undue 
nervousness or anxiety. Unlike the self-re- 
jectant overachiever, her motivational sys- 
tem is not characterized by a strong sense of 
competitiveness. 

The Self-Rejectant Underachiever: The 
self-rejectant underachiever is, without 
doubt, the least motivated of all. She has the 
highest median ACE score of all four sub- 
groups; yet she is more likely to admit that 
she does not try too hard, that she tends to 
“give up” too easily, and that she cannot 
keep her mind on her work. She ranks herself 
relatively high in “optimism,” however, and 
both this optimism and her acknowledged 
tendency to give up too easily are reflected in 
the manner in which she sets her goals. She 
starts out bravely enough and demonstrates 
her initial “optimism” by setting an LA 
that is further from her expected grade than 
those for other groups, and this LA — Gr. 
Exp. gap continues to be greatest on the 
succeeding exams. But only 7% of the self- 
rejectant underachievers achieve LA;, and 
there ensues a rather precipitous drop in LA 
for succeeding exams. The drop is demon- 
strably greater from LA, to LA, than for any 
other group, and from LA, to LAs all the 
other groups are actually increasing their 
LAs appreciably, while that for the self- 
rejectant underachiever continues to de- 
crease. This tendency to pull down the LA, 
obviously related to present lack of moti- 
vation as well as initial overestimation, is 
also indicated in the data relating current 
LA with previous exam grade, where it is 
observed that the discrepancy increases over 
time for all the other groups but actually de- 
creases for the self-rejectant underachiever. 
This has the effect of progressively decreas- 
ing the LA — Gr. Exp. and LA — Gr. dis- 
crepancies, but only because of the drop in 
LA and certainly not because of increased 
motivation and willingness to work hard. As 
a matter of fact, the evidence could most 
reasonably be interpreted as pointing to a 
progressive decrease in motivation through- 
out the semester. Perhaps it is because of 
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her unrealistic goal-setting behavior, her 
lack of motivation, and her chronic non- 
attainment that the self-rejectant under- 
achiever feels at times that she is “no good 
at all.” This may also help to explain her 
high manifest anxiety score. Why, then, does 
she also characterize herself as relatively 
calm, poised, and not inclined to brood or 
worry? One suspects that the self-rejectant 
underachiever expends much psychic energy 
in defense maneuvers of one kind or another; 
it is very possible that her great LA — Gr. 
Exp. discrepancies connote level of aspi- 
ration behavior that is essentially defensive 
in nature—more so than for any other group. 
It would not be surprising if a psychic life 
characterized. by strong repressive tendencies 
and defensive reactions were to result in 
manifest anxiety and equally manifest un- 
derachievement. 

The Self-Rejectant Overachiever: Prob- 
ably the most depressing picture of all is 
presented by the self-rejectant overachiever. 
Her self-description indicates that she is 
more unhappy, more nervous, more high- 
strung, and more easily upset that those 
in the other subgroups; and her manifest 
anxiety score, which is the highest of all 
four subgroups, confirms this self-descrip- 
tion. She feels incompetent, unsuccessful, 
unworthy, and completely lacking in self- 
confidence; and she is often inclined to 
brood over her inadequacies and her troubles 
and to be utterly overcome by life in gen- 
eral. Her anxiety and lack of self-confidence 
are reflected in her goal-setting behavior, 
for she consistently sets her goals more cau- 
tiously and conservatively than those in the 
other subgroups. She sets her LAs far 
closer to previous grade obtained than the 
others, and she always has the least dis- 
crepancy between LA and grade obtained. 
She also more often exceeds her expected 
grade than anyone else. She acknowledges 
that she is ambitious, studious, highly mo- 
tivated, and strongly competitive; and the 
combination of this with her cautious goal- 
setting behavior is probably responsible for 
the smaller LA — Gr. discrepancy and the 
greater tendency to exceed grade expecta- 
tions. Characteristically, however, she re- 
ports more often than the others that “I 
find the standards I set for my own work 
are usually too high for me to attain” de- 
spite the fact that she comes closer to at- 
taining them than anyone else! Faced with 
her deep-seated feelings of unworthiness, the 
self-rejectant overachiever apparently spends 
most of her time in a struggle to achieve 
some shred of self-respect. This struggle 
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takes the form of a desperate and highly 
motivated effort to achieve academic ex- 
cellence. This must be a very difficult task 
for many members of this group, since the 
median ACE percentile rank is only 35, and 
the combination of mediocre ability and 
desperate desire for academic achievement 
must only create further tension and anxiety 
that produce additional misery in an al- 
ready unhappy life. Doubtlessly it is be- 
cause of this extreme emotional investment 
in goal-attainment that the self-rejectant 
overachiever sets her goals so conservatively 
and then tries so desperately to attain them. 
Her sense of personal unworthiness is deeply 
felt, and that is why she must put forth so 
much effort to convince herself and others 
that she is a worthy person after all. 


SuMMARY 


The purpose of this investigation was 
to analyze the patterns of goal-setting be- 
havior and related personality character- 
istics of four groups: self-acceptant un- 
derachievers, self-acceptant overachievers, 
self-rejectant underachievers, and self-re- 
jectant overachievers. Self-acceptance and 
rejection were measured by the Bills’ 
Index of Adjustment and Values. Ss 
were 100 female college students enrolled 
in a course in educational psychology. 
Three examinations were given during the 
course, and before each of these each S was 
asked to indicate the grade she hoped to 
attain on the exam and the grade she actu- 
ally expected to get. In addition to the 
Bills’ scale a personality inventory was ad- 
ministered that included the items of the 
Taylor Manifest Anxiety Scale and other 
items relating to mental health and de- 
sire to achieve. Among other results re- 
ported, it was noted that self-rejectant Ss 
had a significantly smaller discrepancy be- 
tween previous grade and present level of 
aspiration, and there was also an accom- 
panying trend for the self-rejectant Ss to 
exceed their expected grades while the 
self-acceptant consistently overestimated 
theirs. Since underachievement was also 
associated with overestimation of grade, 
the self-acceptant underachiever led all 
four groups in gross overestimation, while 
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the self-rejectant overachiever led the 
others in either achieving or exceeding the 
expected grade. Significant differences in 
manifest anxiety were revealed, with the 
underachievers and self-rejectant Ss ex- 
hibiting greater anxiety, a condition that 


was reflected in the more cautious and 


conservative goal-setting that character- 
ized these groups. Careful analysis of the 
items in the Bills’ scale and in the person- 
ality inventory revealed many interesting 
differences between the four subgroups. 
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PREDICTING LEADERSHIP RATINGS FROM 
HIGH SCHOOL ACTIVITIES" 


JOHN D. KRUMBOLTZ 
Michigan State University 


RAYMOND E. CHRISTAL ann JOE H. WARD, JR. 
Personnel Laboratory, Wright Air Development Center 


Can a self-report questionnaire about 
high school activity participation be used 
to predict later leadership peer ratings? 
A recent review of the literature (Krum- 
boltz, 1957b) concerning the relationship 
of high school activities to leadership cri- 
teria revealed no conclusive evidence one 
way or the other. There was some evidence 
that college activities were predictive of 
future leadership success, but the studies 
dealing with high school activities were of 
such a nature that no valid conclusions 
could be drawn. More recently, a study 
(Krumboltz & Christal, 1957) at the Air 
Force Academy revealed correlations rang- 
ing from .21 to 28 between high school 
activity participation and leadership rat- 
ings. The present study was designed to 
determine whether high school activity 
participation can be used to predict future 
leadership ratings within the aviation ca- 
det population. It is an attempt to verify 
the findings of the Air Force Academy 
study using a different population. How- 
ever, the present study differs in three 
respects. First, a special inventory form 
was developed by which the examinee re- 
cords his high school activity participa- 
tion on an IBM Mark Sense card. Sec- 
ondly, data for individuals from large and 
small high schools were analyzed sepa- 


‘This report is based on work done under 
ARDC Project No. 7719, Task No. 17009, 
in support of the research and development 
program of the Personnel Laboratory, 
Wright Air Development Center, Lackland 
Air Force Base, Texas. Additional support 
was received from an All-University Re- 
search Grant from Michigan State Univer- 
sity. 
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rately. Finally, individual items were se- 
lected and combined by an iterative mul- 
tiple regression technique to produce the 
highest possible relationship with the cri- 
terion. 

The establishment of any positive rela- 
tionship between high school activity par- 
ticipation and leadership criteria does not, 
of course, necessarily indicate a cause and 
effect relationship. If a successful predic- 
tion can be made, this fact has important 
implications in selection program 
whether or not leadership ability may have 
resulted from the training received in high 
school activities. 


a 


Sample 


The total sample consisted of 956 avia- 
tion cadets in preflight training at Lack- 
land Air Force Base, Texas. Of these, 857 
graduated from preflight training, while 
99 were eliminated for a variety of reasons. 
Since students from smaller high schools 
generally have available a fewer number 
of high school activities (although perhaps 
more opportunity to participate in those 
activities which are available), students 
from large and small schools were ana- 
lyzed separately. Each cadet was asked to 
indicate approximately how many persons 
there were in his graduating class includ- 
ing midyear and summer session gradua- 
tion. If he reported 99 or less, he was ar- 
bitrarily considered to be from a “small” 
high school. If he reported 100 or more, 
he was arbitrarily considered to be from 
a “large” high school. 

Six aviation cadet classes were involved 
in this study. The first three, Classes V-15, 
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A-16, and B-17, who entered training in 
June and July of 1956, were grouped to- 
gether and are hereinafter referred to as 
Group A. The three classes who entered 
training in July and August immediately 
after Group A, Classes C-18, D-19, and 
E-20, are hereinafter referred to as Group 
B. 
Thus, four subsamples were formed out 
of the 857 graduates for analysis purposes: 
1. Small high school, Group A, N = 162; 
2. Small high school, Group B, N = 135; 
3. Large high school, Group A, N = 306; 
4. Large high school, Group B, N = 254. 


The High School Activities Inventory 


The High School Activities Inventory 
was devised to measure the extent and na- 
ture of each individual’s participation in 
his high school’s extracurricular (or co- 
curricular) activity program. Since extra- 
curricular programs vary considerably in 
different parts of the country and among 
different high schools in the same geo- 
graphical region, it was necessary to de- 
vise a questionnaire that could be inter- 
preted equally well by anyone attending 
high school anywhere in the United States 
or its territories. Fortunately, it was pos- 
sible to obtain the records of applicants 
to the Air Force Academy Class of 1959. 
Each applicant had written out a list of 
all his extracurricular activities. These lists 
were then consolidated into a master list 
of 226 separate activities. The activities 
ranged from polo to chess and many of 
them were listed by only one individual. 
By combining very specific activities into 
more general categories and by eliminating 
rare types of activities, it was possible to 
reduce the list to a more manageable 44 
activities which were included in the final 
inventory. Actually there were 70 items 
since the extent of one’s participation was 
often included as a separate item under 
one given activity. For example, partici- 
pating in football and winning a letter in 
football were two separate items. 

Each item takes the form of asking how 
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many years an individual participated in 
a given activity or how many years he re- 
ceived a certain honor. The initial instruc- 
tions directed the examinees to consider 
only the last three years of their high 
school career in answering how many 
years they participated. Thus, there were 
only four possible answers to each item: 
0, 1, 2, and 3. In this way individuals who 
attended four-year high schools had no 
“time” advantage over individuals who 
attended three-year high schools. 

It was considered possible that some 
cadets might try to exaggerate the extent 
of their extracurricular participation al- 
though there was no reason why they 
should. To discourage this possibility each 
cadet was asked to list the names and lo- 
cations of the high schools he attended, 
the names of the high school principals, 
and the names of three teachers at each 
high school who could verify his activi- 
ties. Although no attempt was made to 
follow up this information, it was believed 
that the possibility of verifying a cadet’s 
responses made it less likely that he would 
exaggerate them. 

Responses and identifying data were 
recorded on mark sense cards (IBM 
850259MS-O). A list of 20 of the 70 items 
may be found in Table 1 in summarized 
form. For the most part each item is self- 
explanatory if it is understood that each 
activity in Table 1 is preceded by “How 
many years did you participate in...” or 
“How many years did you receive this 
honor....” 

To determine how well the inventory 
covered the wide variety of possible ac- 
tivities the first 200 cadets to answer the 
inventory were asked to write on the back 
of the inventory any activities in which 
they had participated but which were not 
covered in the inventory. A total of 105 
comments were received including two or 
more comments from some cadets. 85 of 
the comments were judged to be irrelevant 
for a variety of reasons, while 20 were 
considered as legitimate criticisms of omis- 
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sions in the inventory. The irrelevant 
comments concerned activities the ques- 
tionnaire was not designed to cover such 
as intramural athletics, high school fra- 
ternities, scholastic awards, and church 
activities. Other irrelevant comments in- 
cluded very specific honors or activities 
which could not be classified, activities 
that had already been covered in the in- 
ventory directly or indirectly, and ex- 
cuses for little or no participation. The 
main area of activity that was omitted by 
the inventory concerned school service 
activities. Four persons listed the visual 
aid department, five were managers of 
athletic teams, seven served on various 
school committees, and four listed other 
miscellaneous school activities. 

Criterion 

Leadership peer ratings were collected 
on the aviation cadet sample twice during 
their preflight training. Each man in a 
flight was asked to rank-order each other 
man in his flight on the basis of his leader- 
ship potential. The first time was after the 
first four weeks of training, and the sec- 
ond time was after the first ten weeks of 
training. Cadets were rank-ordered on the 
basis of the pooled rankings within each 
flight, and the rank orders were then con- 
verted to 7 scores. The stability of these 
rankings over a six-week interval is indi- 
cated by correlations for the six classes 
ranging from 40 to .82 with a median r 
of about .68. 

A number of studies (Hollander, 1957; 
Trites & Sells, 1957; United States De- 
partment of the Army: 1949, 1952) have 
demonstrated the reliability and validity 
of peer ratings as an intermediate criterion 
of future leadership behavior. The results 
of these and other studies have been briefly 
discussed elsewhere (Hollander, 1957; 
Krumboltz, 1957a). It may be concluded 
from these studies that leadership peer 
ratings have a substantial relationship to 
future leadership ratings collected in an 
on-the-job situation. 


Statistical Methodology 


Two techniques were used to analyze 
the data. The first consisted of summing 
the weighted responses to each item (ie., 
adding the number of years recorded for 
each item) and computing the zero order 
correlation of this sum with the criterion. 
This was done separately for athletic 
items and for nonathletic items for each 
of the four samples. 

The second technique consisted of se- 
lecting and weighting items by an iterative 
multiple regression technique so as to 
produce the highest possible relationship 
with the criterion. The basic procedure 
that was used to obtain the regression co- 
efficients has been described by Green- 
berger and Ward (1956). This technique 
starts with all regression coefficients equal 
to zero. At each iteration the unique cor- 
rection is computed for each regression 
coefficient that will maximally increase the 
multiple correlation. The alteration is 
made only on the one particular variable 
which has the largest correction. 

For each of the four samples it was first 
necessary to compute the column vector 
of validities. The iterative technique then 
proceeds to indicate the column vectors 
of intercorrelations that are successively 
required for the regression computation. 
As a result, if there are only & predictor 
variables used out of the 70 original po- 
tential predictors, then it is necessary to 
compute only the 70 by (k + 1) rectangu- 
lar matrix of correlation coefficients. 

The problem associated with “when to 
stop iterating” is as yet unsolved; how- 
ever, it has been observed that an F test 
for the significance of the increase of pre- 
dictive efficiency gives an approximate in- 
dieation of a “good” place to stop. After 
the “best” set of k variables had been 
selected for each sample, the iterations 
were continued on the variables that were 
retained until a least squares solution was 
reached for the k predictors. The regres- 
sion equation computed for each of the 
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TABLE 1 


Correlation with Criterion in 
~ | Mean No. 
Item No| Activity Small HS Large HS a 
A B A | 857) 
(N = 162))(N = 135)|(N = 306)|(N = 254) 
| Football .18* 18 19 80 
3 Basketball .04 .29* .25* 
7 =| Track 18 12 .07 — .02 46 
13. Tennis — .08 .00 
15 | Swimming 04 .20* .02 
19 Other sport — .16* — .02 .03 — .01 
23. +| Newspaper assistant — .15* — .04* —.13 14 .09 
| editor 
25 Newspaper photog- — .07 — .07 —.17* .02 
rapher 
34 Debate team .14* .18* ll — .03 .10 
36 Chorus or glee club 07 05 —.01 .18* -52 
41 | Science club member | —.O8 — .23* — .08 .04 31 
44 | Language club member .00 .16* .00 a -22 
47 | Hobby or interest club | —.15 —.17* —.04 — .09* 49 
member | 
57 Student government | —.06 ll ll .20* .06 
| president 
58 Student government: | — .12* — .07 .08 14 14 
other officer | 
59 | Student government: | —.03 o9* 15 ll 34 
member 
63 President of class | —.02 .06 .16 -23° 14 
64 | Vice-president of class 09 -20 .18* 14 12 
65 | Secretary of class 03 12 .15* — .06 .07 
69 | Outstanding student 13° —.01 — .04 .00 13 
award 


* Items weighted into multiple regression equations. 


four samples was then applied to all sam- 
ples for cross validation. 
AND Discussion 
The correlations of each of 20 items 


with the criterion for each of the four sam- 
ples are reported in Table 12 Asterisks 


* A four-page table for all 70 items and 
including the extent of participation by 
eliminees as well as graduates has been de- 
posited with the American Documentation 
Institute, Order Document No. 5955 from 
ADI Auxiliary Publications Project, Photo- 
duplication Service, Library of Congress, 
Washington 25, D. C. remitting in advance 
$1.25 for microfilm or $1.25 for photocopies. 
Make checks payable to Chief, Photodupli- 
cation Service, Library of Congress. 


beside a correlation indicate that the item 
was weighted into the multiple regression 
equation for that sample. The 20 items 
appearing in Table 1 were selected from 
among those judged to be of most interest 
and yielding the most substantial relation- 
ships with the criterion. 

Positive correlations were consistently 
obtained for most of the major sports and 
for athletic honors. In small high schools 
being assistant editor on the school news- 
paper received negative weight, while be- 
ing a member of the debate team received 
positive weight. In large high schools being 
president or vice-president of the class 
was consistently and positively related to 
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TABLE 2 
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Athletic 
Score 


| 
| 


® Subscripts represent the following variables: a, Athletic Activity Score; n, Non-athletic Activity Score; t, Total 


Activity Score; and c, the leadership criterion. 
** Significant at the .01 level. 


high leadership ratings, while such con- 
sistent relauionships were not found for 
the small high school samples. Being a 
member or officer in student government 
was positively related to the criterion in 
large high schools but not in small high 
schools. 

Many items that one might reasonably 
expect to be positively related to leader- 
ship ratings showed no relationship what- 
soever. For example, all of the following 
were unrelated to the criterion: being a 
delegate to Boys’ State; being president 
of a career interest club, a hobby or in- 
terest club, a language club, or a science 
club; and being editor of the school news- 
paper or yearbook. The reasons for this 
are a matter for conjecture. Perhaps indi- 
viduals with relatively low leadership 
ability go into such activities. Being presi- 
dent or editor in a group of nonleaders 
would then give no indication of one’s 
leadership status in a larger more repre- 
sentative group. Perhaps leadership is spe- 
cific to the situation. 

By summing each individual’s responses 
to items 1-20 and 70, and Athletie Activity 
Seore was computed for each individual. 
Similarly the summation of each cadet’s 
responses to items 21-69 provided his 
Nonathletie Activity Score. The sum of 
these two scores was the Total Activity 
Score. Table 2 reports the zero order cor- 
relations of each score with the criterion 
and the correlations of the Athletic and 


me | 36 | 421] 6. 


Nonathletie Activity Scores for each sam- 
ple. The correlations of the Athletic Ac- 
tivity Score with the criterion ranged 
from .10 to .29 and were consistently 
higher than the correlations of the Non- 
athletic Activity Score with the criterion 
which ranged from —.05 to .18. 

The multiple regression equations de- 
rived from each sample yielded spuriously 
high multiple Rs ranging from .36 to .62. 
When the regression equations derived 
from each sample were cross-validated on 
each other sample, the results shown in 
Table 3 were obtained. It is of special 
interest to note the cross-validities of the 
small high school samples on each other 
and the cross-validities of the large high 
school samples on each other. Multiple 
Rs shrank from .47 to .17 and from .62 to 
19 in the small high school samples. In 
the large high school samples the multiple 
Rs shrank from .36 to .19 and from 42 to 
14, 


TABLE 3 
VALIDITIES OF REGRESSION EQUATIONS IN 
SAMPLE 


| Validated on 
Weights | Sample 
Derived from | WN 
Sample 


Criterion 


1/2) 4/|Mean| SD 


1. 8: 19 .11).03,100.7,16.1 
2. SB | 135 |.17 .19|.12| 98.7/15.8 
3. LA | 306 .16 .21 .14,100.114.5 
4. LB 254 |.11).29).19 100.1 15 


4 
| 
ZERO ORDER CoRRELATIONS or Activity ScoRES WITH THE LEADERSHIP CRITERION 
| te | te foo | Pee Mean | SD | Mean | SD 
> 1. SA | 162 | .10 | -—.05 «+ | o2 | 63 | 63 | 10.8 | 7.3 

2. SB 135 | .29°* 02 18 | 5.7 | 5.2 9.2 | 6.1 
3.LA 306 | .18** 06 2 | 38 76 | 6.5 
4 4. LB | 254 .23** .18** poe 7 5.5 3 
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SUMMARY AND CONCLUSIONS 


The purpose of this study was to de- 
termine whether a self-report question- 
naire about high school activity participa- 
tion can be used to predict later leadership 
peer ratings. An inventory on high school 
activity participation was administered 
to a total of 956 aviation cadets undergo- 
ing preflight training at Lackland Air 
Force Base. The criterion consisted of the 
summation of T-scored leadership peer 
ratings collected after the fourth and after 
the tenth week of training. The data were 
analyzed by computing zero order and 
multiple correlations between the predic- 
tor items and the criterion. 

The analysis revealed consistently low 
but positive correlations between inven- 
tory scores and the criterion. The multiple 
regression equations derived from each 
subsample yielded multiple Rs which 
shrank upon cross-validation on compara- 
ble samples to values which ranged from 
.14 to .19 with a median of .18. Three of 
the four zero order correlations between 
the Athletic Activity Index and the cri- 
terion were significantly different from 
zero at the .01 level. Only one of the four 
correlations between the Nonathletic Ac- 
tivity Index and the criterion reached sig- 
nificance. 

On the basis of these results the follow- 
ing conclusions were reached: 

1. A self-report inventory on extracur- 
ricular participation succeeded in predict- 
ing leadership ratings of aviation cadets 
better than chance, but considerable error 
still remained in such predictions. The low 
positive correlations do not, of course, nec- 
essarily mean that training received in 
high school activities produced increased 
leadership ability since those choosing to 
take part in high school activities might 
very well have been above average in 
leadership ability originally. 

2. Although certain types of activities 
tended to have differential predictive 
power for peopie from large and small 


J.D. KRUMBOLTZ, R. E. CHRISTAL, AND J. H. WARD, JR. 


high schools, in general activities in large 

and small high schools were about equally 

predictive of the criterion. 

3. Athletic participation and honors 
were more predictive of future leadership 
than nonathletic participation and honors. 

4. The iterative multiple regression 
technique did not produce a more valid 
composite than the simpler zero order 
correlation technique in this study. 
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EFFECTS OF SOCIAL RECOGNITION UPON THE EDUCATIONAL 
MOTIVATION OF TALENTED YOUTH 


DONALD L. THISTLETHWAITE' 
National Merit Scholarship Corporation 


A persistent problem in American ed- 
ucation—made more imperative by recent 
concern over Sputnik—is that of stimu- 
lating able students to realize their educa- 
tional potential. What can be done to 
motivate talented youth to seek further 
specialized training? Because careers in 
science and education do not usually pay 
well, talented students are frequently di- 
verted into careers which, though more 
lucrative, are incommensurate with their 
abilities. Awards for scholastic achieve- 
ment and other forms of social recognition 
have frequently been used to stimulate the 
student’s motivation for higher education, 
but controlled studies of the effectiveness 
of social recognition as an incentive have 
been rare. 

Previous studies have suggested that 
giving students social recognition for out- 
standing performances on aptitude tests 
tends to increase their motivation to at- 
tend college and their success in obtaining 
scholarship aid. Thistlethwaite (1958) es- 
timates that, of the near winners receiving 
recognition in the second Merit competi- 
tion, only about 3% did not enroll in 
college—a dropout rate which is less than 
half of the most conservative estimate 
(Phearman, 1949) made before the initia- 
tion of the Merit Scholarship program. It 
was hypothesized that this extremely low 
dropout rate was a consequence of the 
public recognition which the near winners 
received in the Merit program. Holland 
and Stalnaker (1957) report that two- 
thirds of the finalists not receiving Merit 
Scholarships in the first Merit competi- 


*The writer is indebted to Laura Kent 
for her helpful editorial comments on drafts 
of this paper. This study was partially sup- 
ported by the National Science Foundation 
and the Old Dominion Foundation. 
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tion managed to obtain scholarships from 
other sources and that half of these stu- 
dents attributed their success in part to 
the recognition they had received. 

To obtain a more reliable and compre- 
hensive estimate of the effects of recogni- 
tion, the present ex post facto study com- 
pares two groups of talented students 
receiving different amounts of public rec- 
ognition. The two groups differ, then, in 
the amount of social support they received 
for academic achievement; it is also pos- 
sible that they differ in their self-evalua- 
tions, as a result of learning how they 
rank relative to other talented students. 
Since both groups received some degree of 
recognition, these results tend to give a 
conservative estimate of the effects. A 
comparison of more disparate groups 
would probably reveal larger differences. 
But even though the magnitude of effects 
is probably underestimated, some of the 
student behaviors influenced by public 
recognition are revealed by the present 
study. 


METHOD 


The first group (Group A) was selected 
from the 5126 students (80% of the Cer- 
tificate of Merit winners in the 1957 pro- 
gram) who replied to a survey sent to all 
C of M winners. Each member of Group 
A had received a C of M attesting to his 
“high potential for college achievement” 
as demonstrated by a “distinguished per- 
formance on the nationwide selection tests 
for Merit Scholarships” and had had his 
name published in a booklet which was 
distributed to all accredited junior and 
senior colleges, to universities, and to a 
large number of other scholarship-grant- 
ing agencies. In addition, these students 
were frequently publicized by press serv- 
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ices and acclaimed at high school assem- 
blies. The second group (Group B) was 
drawn from 2848 of the second-highest- 
scoring 7500 students, who had received 
a letter of commendation and somewhat 
less recognition in the press. The pool 
from which Group B was drawn repre- 
sents the 80% replying to a survey sent 
to a 47% random sample of commended 
students. No attempt was made to an- 
nounce the names of the commended stu- 
dents to colleges and universities or to 
other scholarship donors. A count of press 
clippings shows that news items totalled 
approximately 2600 for C of M winners 
and 1100 for commended students—a ra- 
tio of approximately two and one-half to 


one. 
Matching Variables 


So that the two groups would be com- 
parable, C of M winners were matched 
with commended students on the follow- 
ing variables: (a) sex, (b) verbal aptitude 
seore (the College Entrance Examination 
Board Scholarship Qualifying Test), (c) 
geographical region, and (d) father’s oc- 
cupational class. The majority of the re- 
sponses to the question about father’s oc- 
cupation were assigned to classes on the 
basis of fixed-alternative choices; the re- 
maining “free’’ responses were coded using 
the Minnesota Scale of Paternal Occupa- 
tions (1955). From Holland’s comparison 
of father’s occupational class (as defined 
by the Minnesota Scale) with family in- 
come as reported by 800 finalists in the 
1956 Merit program (1958), it is esti- 
mated that the tetrachoric correlation be- 
tween these two variables is .64; thus, 
father’s occupational class is a crude in- 
dex of the family resources available for 
sending the student to college. In addi- 


*Commended students received their let- 
ters of commendation four to six weeks be- 
fore the C of M winners received their 
certificates. Thus the commended students 
had the advantage of prior recognition in 
applying to other donors for scholarship aid. 
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tion, a rough matching was made on 
mathematical aptitude (SQT-M). The use 
of these matching variables resulted in 
1302 matched pairs, each pair made up 
of a C of M winner (Group A) and a 
commended student (Group B). There 
were no significant differences between the 
two groups with respect to SQT-V, geo- 
graphical origin, or father’s occupation. 
Sex distributions were identical. However, 
on the mathematical subscale of the SQT, 
Group A has a mean which was 1.7 units 
greater than the mean of Group B—a dif- 
ference small in magnitude but neverthe- 
less statistically significant (p < 01). 
Since both members of a pair were iden- 
tical with respect to the four primary con- 
trol variables but differed in the amount 
of publie recognition they had received, it 
was possible to study the effects that such 
recognition has on students. 


Measurement of Attitudes 


To provide a measure of the impact of 
recognition upon attitudes toward intel- 
lectualism, the following eight items were 
included in the surveys (each response in 
the keyed direction was weighted one) : 


1. College teachers complain a lot about 
their pay, but it seems to me they get as 
much as they deserve. Disagree. 

2. The work of theoreticians and scholars 
should be subsidized even though it may 
lack practical value. Agree. 

3. Science and philosophy have their 
place, but there are probably many impor- 
tant things that can never be understood by 
the human mind. Disagree 

4. I spend more of my free time reading 
than I do watching television. Yes. 

5. Most intellectuals are extremely com- 
petent persons and would excel in almost 
any job they undertake. Agree. 

6. I am annoyed by writers who go out 
of their way to use strange and unusual 
words. No. 

7. Generally the man of ideas is more 
important to society than the man of action. 
Agree. 

8. I would rather write a fine book than 
be an important public figure. Agree. 
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SOCIAL RECOGNITION AND EDUCATIONAL MOTIVATION 


RESULTS 


Attitudes Toward Intellectualism 


One of the aims of the nationwide talent 
search annually conducted by the Na- 
tional Merit Scholarship Corporation is 
to call attention to intellectual attainment 
and, thereby, to stimulate promising 
young scholars and scientists to seek fur- 
ther specialized training. It is reasonable 
therefore to regard differences in attitude 
toward scientific or scholarly careers as 
one criterion of the effectiveness of the 
Certificate of Merit awards. Students in 
Group A tend to have higher intellectual- 
ism scores than those in Group B (p < 
O01). Further, recognition has statistically 
significant effects the attitudes of 
girls, students whose fathers are not em- 
ployed in professional or managerial oc- 
cupations, and students with relatively 
high verbal aptitudes. Boys and students 
whose fathers are in professional or semi- 
professional occupations tend to be in- 
fluenced in the same manner, although 
these influences are slightly smaller. The 
crucial question is, of course, whether 
these changes in attitudes are paralleled 


upon 


by similar changes in career plans. 
Career Plans 


An examination of the vocational plans 
of students in Groups A and B corrobo- 
rates the findings suggested by the pre- 
ceeding analysis. Public recognition tends 
not only to change the “verbal” attitudes 
of students—but also to change their ca- 
reer plans. Students in each group were 
told to “check the vocation you now plan 
to enter as your life work.” A significantly 
greater proportion of the students in 
Group A report they are planning to be 
college teachers or scientific researchers. 
Table 2 shows that this effect, like the 
effect upon attitudes toward intellectu- 
alism, occurs primarily among girls and 
among students whose fathers are not em- 
ployed in professional or managerial oc- 
cupations. 
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TABLE 1 


Errects or Sociat RecoGnition Upon 
ATTITUDES TOWARD INTELLECTUALISM 


Percentage | 
of AB pairs | 
Classification* | had Neher | p> 
| intellectual 
ism score 
High SQT-V | 
Low SQT-V 
Boys 53 
Girls 55 
Professional or semi-| 64- 53 
professional father 
Nonprofessional 335 | 55 
father 
Total 


55.6 
53.2 


979 dA. 


* The mean SQT-V score for “high aptitude” mem 


bers of Group A was 48.3; for matched Group B students, 
48.2. Corresponding mean scores for “low aptitude’’ A 
and B students were 41.3 and 40.8, respectively. The term 
“low aptitude” (which designated AB pairs in which the 
B member's score fell below the Group B median) is not 
descriptive in an absolute sense, since those students had 
a mean score above the 96th percentile relative to esti 
mated national norms for public high school seniors 

> Two-tailed test based upon tests of the significance 
of correlated proportions have been used in this, and in 
succeeding, tables to estimate probability values 


Despite the similarity of the results in 
Tables 1 and 2, it appears that items call- 
ing for an expression of vocational plans 
measure different than items 
which call for the 
fuse beliefs and preferences. For example, 
changes in attitudes occur primarily 
among students with exceptionally high 
verbal aptitudes (Table 1), whereas 
changes in vocational plans occur prima- 
rily among students with only moderately 
high verbal aptitudes (Table 2). The for- 
mer, it may be assumed, are influenced by 
recognition to place a greater value upon 
intellectual achievement in the arts, hu- 
manities, and social sciences, but are not 


processes 
xpression of more dif- 


attracted to careers in scientific research. 
Students who have only moderately high 
verbal aptitudes, on the other hand, are 
influenced by recognition to go into sci- 
ence careers, even though their attitudes 
toward scholarly pursuits do not change. 
In short, it is hypothesized that the in- 
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TABLE 2 


Errects or SoctaL RecoGnition Upon PLANs TO BE A COLLEGE 


TEACHER OR ScientiFic RESEARCHER 


Percentage planning to | 
| be a college teacher or | 
Classification | No. of pairs* scientific researcher _| Percent. diff. p> 
| Group A | Group B 
| 
High SQT-V 672 24.2 | 21.7 2.5 -- 
Low SQT-V 620 23.5 17.9 5.6 <.02 
Boys 850 24.9 | 22.2 2.7 _ 
Girls 442 21.9 15.4 6.5 < .02 
Professional or semipro- 827 23.4 | 20.4 3.0 — 
fessional father 
Nonprofessional father 465 24.7 18.7 6.0 < .03 
1290 24.0 19.9 4.1 <.02 


* The number of pairs vary among the tables because of nonresponse to survey items. 
> Two-tailed tests of the significance of differences between correlated proportions have been used in this, and in 


succeeding, tables to estimate probability values. 


TABLE 3 
Errects oF Upon PLaNs To Seek or MD Decree 


No. of pairs 


Classification 


to get 
the PhD or MD degree 


Percentage planning 


High SQT-V 662 
Low SQT-V 620 
Boys 845 
Girls 437 
Professional or semipro- 821 
fessional father 
Nonprofessional father 461 
Total 


Percent. diff.) p 
37.3 | 34.0 3.3 - 
38.7 | 32.8 5.9 05 
491 45.1 4.0 
16.5 | 10.5 6.0 <.02 
40.8 35.8 5.0 <.03 
38.0 33.4 46 


tellectualism scale is primarily sensitive to 
an intellectual orientation toward the arts, 
humanities, and social sciences; whereas 
the analysis presented in Table 2 prima- 
rily reflects differences in orientation to- 
ward a scientific career. 


Motivation to Seek Advanced Training 


Similar trends were observed when the 
educational plans of Groups A and B were 
compared. A significantly greater propor- 
tion of Group A reported plans to seek 
the PhD or MD degree (Table 3). Slightly 
greater—though not significantly greater 
—effects were observed among girls, stu- 


dents with only moderately high verbal 
aptitudes, and among students whose fa- 
thers are in professional or semiprofes- 
sional occupations. 


Success in Obtaining Scholarships From 
Other Sources 


Public recognition increases significantly 
the likelihood that the student will receive 
scholarship aid. 60% of the students in 
Group A and 55% of the students in 
Group B hold freshman scholarships (p 
< .02). Table 4 shows that the effects of 
recognition upon success in obtaining as- 
sistance occur primarily among boys, stu- 
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TABLE 4 


Errects or Recognition Upon Success iN OBTAINING SCHOLARSHIP ASSISTANCE 


| Percentage of | 
| _ Students | 
Classification No. of pairs| holding scholarships | Percent. diff. p 
— 
Group A | Group B | 
| 
High SQT-V 616 59.7 57.1 | 2.6 — 
Low SQT-V 582 60.3 52.9 | 7.4 <.01 
Boys 791 61.3 56.3 | 5.0 <.05 
Girls 407 57.5 | 52.8 4.7 _ 
Professional or semipro- 791 53.2 47.8 5.4 <.04 
fessional father 
Nonprofessional father 407 73.2 69.3 3.9 —- 
Total 1198 60.0 55.1 4.9 <.02 


dents with only moderately high verbal 
aptitudes, and students whose fathers are 
employed in professional or semiprofes- 
sional occupations. 

It has already been pointed out that in 
applying to other donors for scholarships, 
Group B had the advantage of prior rec- 
ognition. It seems likely that, if the two 
groups had received their different degrees 
of recognition simultaneously, there would 
have been a greater difference between 
them with respect to their success in win- 
ning scholarships. 


Proportions Enrolling in College 


Because almost all of these students are 
collegesbound, the hypothesized effects of 
recognition upon the decision to go to 
college could not be adequately tested. 
Approximately 96% of each group en- 
rolled in college. Of those who did not en- 
roll, the majority deferred their college 
plans only temporarily, usually because of 
military service or lack of financial re- 
sources. Because of the extreme marginals, 
no appreciable differences were expected— 
and none were found—between Groups A 
and B in the proportions entering college 
immediately. 


Discussion 


The major effects of social recognition 
for outstanding performances on aptitude 
tests are: (a) to make more favorable 


the recipient’s attitudes toward intellec- 
tualism, (6) to motivate him to enter a 
college teaching or a scientific research 
career, (c) to stimulate him to seek ad- 
vanced degrees, and (d) to increase the 
likelihood that he will obtain scholarship 
assistance in college. It might be expected 
that public recognition has the greatest 
effect upon the “late-bloomer”—the highly 
talented student who has not had a par- 
ticularly distinguished record of achieve- 
ment in high school. Such students are, of 
course, the very ones a talent search seeks 
to discover and influence; those students 
whose talents have been largely unrecog- 
nized by their peers and teachers should 
be more influenced by public recognition 
than the valedictorians or salutatorians of 
high school classes. To check this hypoth- 
esis, additional comparisons were made of 
the AB pairs after they had been sorted 
by the high school rank of the C of M 
winner (unfortunately high school ranks 
were not available on members of Group 
B, so that these comparisons are less 
rigorous than desired). As expected, rec- 
ognition produced the greatest increments 
in favorableness toward intellectualism 
among the students who had high ver- 
bal aptitudes (SQT-V scores above the 
group’s median) but relatively undistin- 
guished records of high school achieve- 
ment (percentile ranks below the group’s 
median). On the other hand, recognition 
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did not have an exceptionally great in- 
fluence upon the “late-bloomer’s” career 
plans or upon plans to seek the PhD or 
MD degrees. It may be that such stu- 
dents, being unaccustomed to evaluating 
themselves as persons of outstanding tal- 
ent, need time to rethink their vocational 
plans. It is possible that marked “sleeper 
effects” will be found among these stu- 
dents—that is, the effects of public ree- 
ognition upon the “late-bloomer’s” career 
plans may not be fully manifest on an 
immediate after-test, but only after a vear 
or more in college.” 

In interpreting these results, one point 
should be kept in mind: both Group A 
and Group B received considerable public 
recognition. Although the two groups dif- 
fered in type and amount of recognition 
received, differences were not as marked 
as those which would be found if “ree- 
ognized” and “not recognized” groups 
were compared. Consequently, the mag- 
nitude of effects is probably less than that 
which would be observed in the ideal ex- 
perimental comparison. The two groups 
are not perfectly matched, it is true, in 
mathematical aptitude, but the difference 
between them is very small. There is also 
the possibility—present in all ex post 
facto designs—that the observed effects 
are influenced by extraneous factors. On 
the other hand, the literature suggests 
that the matching control variables used 
account for most of the predictable vari- 
ance in college-going behaviors (Berdie, 
1954; Edueational Testing Service, 1957: 
Hollingshead, 1952). On the bases of our 
present knowledge, therefore, we may con- 
clude that all obvious extraneous variables 
have been reasonably well controlled, and 
that the results probably err in that they 
underestimate the effects of public rec- 
ognition. 

SUMMARY 


An ex post facto comparison was made 


of the educational motivation of two 


*The present results are based upon sur- 
veys made approximately six months after 
graduation from high school. 


DONALD L. THISTLETHWAITE 


groups of talented students receiving dif- 
ferent amounts of social recognition for 
their performances on college aptitude 
tests in a nationwide scholarship competi- 
tion. Increased recognition was observed 
to increase the favorableness of attitudes 
toward intellectualism, the number of stu- 
dents planning to seek the PhD or MD 
degree, and the number planning to be- 
come college teachers or scientific re- 
searchers. The latter effect was observed 
particularly among students whose fa- 
thers are employed in nonprofessional oc- 
cupations and among students who have 
only moderately high verbal aptitudes. In 
addition, increased recognition was 
served to increase the likelihood that the 
students will obtain a scholarship from 
his college or from some other scholarship 
granting agencies. 


ob- 
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INTERCORRELATIONS AMONG VARIOUS INTELLIGENCE, 
ACHIEVEMENT, AND SOCIAL CLASS SCORES 


LOTUS M. KNIEF 
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anp JAMES B. STROUD 
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This investigation was planned, first, to 
provide additional data on the socia! class 
or culture bias issue in intelligence testing 
and, second, to ascertain interrelationships 
among certain relatively new intelligence 
tests and scholastic achievement. Scores on 
the following measures were intercorre- 
lated: (a) Lorge-Thorndike Intelligence 
Tests, Verbal; (6) Lorge-Thorndike In- 
telligence Tests, Nonverbal (Level 3 in 
both instances); (c) Davis-Eells Games 
(Elementary Level); (d) Raven’s Pro- 
gressive Matrices; (e) lowa Tests of Basic 
Skills; and (f) the Warner Index of Status 
Characteristics. 

PROCEDURE 

All of these tests except the Progressive 
Matrices were administered to a sample of 
344 fourth grade pupils in a Midwestern 
city of about 80,000 general population. 
The basic sample consisted of all the pupils 
in this grade present at the time the tests 
were administered in 6 of the 18 elemen- 
tary schools. The 18 schools were ranked 


upon the basis of mean scores achieved on 
the Iowa Tests of Basic Skills administered 
in a city-wide testing program. From this 
ranking every third school was selected 
and incorporated in the sample. The Pro- 


gressive Matrices test administered 
the following year to the pupils, now fifth 
grade, in every other fourth grade class in 
the six schools used originally. This pro- 
cedure yielded only 164 pupils tested by 
the Progressive Matrices who had 
taken all the other tests the year previ- 
ously. The Iowa Tests of Basic Skills were 
administered in January 1957. The Davis- 
Eells test and the verbal and nonverbal 


was 
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tests of the Lorge-Thorndike battery were 
administered two or three weeks later; the 
Progressive Matrices, in the spring of 1958. 

A modified Warner scale based upon oc- 
cupation, house type, and dwelling area, 
weighted 5, 4, and 3, respectively, was 
used to assign social class ratings. Fathers’ 
occupations were obtained from the school 
records. In 54 per cent of the cases the 
employers were interviewed in order to ob- 
tain a more precise job description. In as- 
signing house-type and dwelling-area val- 
ues the writers were assisted greatly by 
the City Assessor of the city involved. Pu- 
pils in the sample were rated on a 7-point 
scale on each of the three categories used, 
the assigned ratings were multiplied by 
the weights indicated above, and the prod- 
ucts summed to provide a total ISC score 
value for each pupil in the sample. Accord- 
ing to Warner estimates the following n’s 
would be expected for a sample of the size 
here used: 11, 34, 96, 117, and 86, for UU 
and LU (combined), UM, LM, UL, and 
LL classes, respectively. The obtained val- 
ues were 11, 34, 100, 117, and 82. 

In order to describe the sample further 
and to supply data on the behavior of the 
tests used, means and standard deviations 
are here given: 


VARIABLE 
Warner ISC 
Davis-Eells IQ 
L-T Verbal IQ 
L-T Nonverbal IQ 
ITBS Composite’ 


‘Towa Tests of Basic Skills scores are 
grade equivalent scores. 45.1 should be read 


as 5.1 months into the fourth grade 


— 
q i 
hi 
a 
a 
MEAN SD 
50.9 14.8 
104.5 15.4 
106.5 13.9 
108.8 13.7 
i, 45.1 10.4 
| 
4 
he 


RESULTS 


The zero order correlations among ISC, 
the intelligence scores, and ITBS Compos- 
ite are shown in Table 1. As noted, the 
Progressive Matrices test was not adminis- 
tered at the same time as the other tests 
nor was it administered to all of the origi- 
nal sample. As supplemental data of some 
interest, correlations between raw scores 
on this test and scores on the other tests 
employed in this investigation were ob- 
tained and are reported in Table 1. 

It may be of some interest to report the 
correlations between each of the intelli- 
gence scores and the various ITBS subtest 
scores. This is done in Table 2. 


TABLE 1 
INTERCORRELATIONS AMONG ISC, INTEL- 
LIGENCE Measures, anp ITBS 
Composite Scores 


(N = 344) 

Variable | 6 
1. ISC | | .323) .179|.340 
2. D-E 1Q | | 571) .645, 405) .568 
3.L-TVIQ | | .709| .437 839 
4. L-T NV IQ | |. 521) .683 
5. Prog. | | | |.450 

Matrices* | | 
6. ITBS 
Composite | | 


* Test 5, N = 164. 


TABLE 2 
CORRELATIONS BETWEEN ISC, THE INTEL- 
IGENCE MEASURES, AND VARIOUS 
ITBS Susrests 


(N = 344) 
ITBS Tests 
| 
Sis | Bia 
Isc 255) .323).290) 365) .288 
D-E 1Q 516.561) .532).446!.515 
L-T V IQ |: 776| .752|.726).739 
L-T NV IQ 580! .608} .679| .576|.663 
|-359) 438) 424 


Prog. Matrices* |. 374) 449 
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TABLE 3 
PARTIAL CORRELATION COEFFICIENTS 
Amona ISC, INTELLIGENCE, AND 
ITBS Composite Scores 


(N = 344) 
Variables* Partial Zero Order 
Coefficient | r’s 
51.4 |  .518* | 51 = .568 
52.4 | .821* | 52 = .839 
53.4 .644* | 53 = .683 
54.1 54 = .340 
54.2 .163* | .340 
54.3 .173* .340 
*5 = ITBS Composite 
l= D-EIQ 
2=L-TVIQ 
3=L-T NVIQ 
4=I8SC 


* Significant at .01. 


Further analysis of the data was at- 
tempted by means of partial and multiple 
correlation procedures. Correlations were 
computed (a) between scores on each of 
the original three intelligence tests and 
ITBS Composite, with ISC scores par- 
tialled out, and (6) between ISC and ITBS 
Composite scores, with scores on each of 
the original three intelligence tests par- 
tialled out in turn. The coefficients are 
shown in Table 3, together with zero order 
correlations between the first two vari- 
ables. 

In the multiple correlation analysis Rs 
were computed between ITBS scores and 
various combinations of intelligence scores, 
taking two tests at a time. These are pre- 
sented in Table 4, together with the zero 
order correlations between ITBS and the 
other tests involved, for the reader’s con- 
venience. 

As a further step multiple regression 
analysis was performed with ITBS Com- 
posite scores as the dependent variable and 
ISC and the original three intelligence 
scores as independent variables. Beta 
weights were determined and tested for 
significance, regression equations devel- 
oped, and multiple Rs computed. The re- 
sults are reported in Table 5. The values 
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INTELLIGENCE, ACHIEVEMENT, AND SOCIAL CLASS 


given above each column represent the R 
between ITBS and the other tests em- 
ployed in that column. 

By way of a brief discussion, attention 
is called to some of the more pertinent re- 
sults obtained. All of the intelligence tests 
used and the ITBS Composite scores cor- 
related significantly with social status 
(ISC scores), and, with the exception of 
the Progressive Matrices, to approximately 
the same extent. The partialling out of the 
various intelligence scores resulted in 
lower, but still significant, correlations be- 
tween ISC and ITBS. The partialling out 
procedure tended to lower the correlations 
between ITBS and both the Davis-Eells 
and L-T nonverbal scores more than that 
between L-T verbal and ITBS. However, 
this tendency is more apparent than real. 
When the r’s involved are transformed into 
z values, the relationships between ITBS 
and the two kinds of intelligence scores 
(verbal and nonverbal) appear to be re- 
duced about equally. 

When, in multiple correlation, ISC 
scores were combined with the various in- 
telligence scores, there was a slight tend- 
ency for this procedure to increase the Rs 
between Davis-Eells and L-T nonverbal 
scores and ITBS more than the R between 
L-T verbal and ITBS. However, again, 
when z transformations are made, the dif- 
ferences are negligible. Our reasoning was 
that, if the Davis-Eells and L-T nonverbal 
tests are influenced less by cultural status 
than the L-T verbal test, combining ISC 
scores with those of the two former tests 
should raise their correlation with ITBS 
more than combining them with the verbal 
scores, since the latter, by some arguments, 
already contain social class loadings. This 
did not prove to be the case. It should be 
noted that the authors of the verbal test 
in question were cognizant of the culture 
bias factor and went to considerable length 
to minimize it. 

Perhaps the most important result from 
the multiple correlation analysis is the light 
it sheds upon the behavior of the tests in- 
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TABLE 4 


CORRELATION COEFFICIENTS, 
THREE-VARIABLE COMBINATIONS 


Zero Order 


Combination* 
r’s 


568 
839 


5.23 


*5 = ITBS Composite 
D-EIQ 
2=L-TVIQ 
3= LT NVIQ 
4=I18C 


TABLE 5 
MULTIPLE CoRRELATION COEFFICIENTS AND 
Beta WEIGHTS FOR REGRESSION 
ANALYSES 


ITBS Composite Scores 
Multiple 
Rs: 


.076**|.111* 


|.067**| .074**) 
D-E IQ __|.073 | -083°* -117* |.200* 
L-T V IQ |.687* |.702* |.694* |.749* 
L-T NV_|.127* |.161° |.137* 

1Q | 

* Significant at .01. 

** Significant at .05. 


ISC 


.518* 


volved. The zero order r’s showed that the 
L-T verbal test gave the best prediction 
of ITBS scores, followed in order by L-T 
nonverbal and Davis-Eells. The multiple 
correlation analysis showed that L-T ver- 
bal alone correlated with ITBS about as 
well as did the entire battery of tests when 
combined in multiple correlation analysis. 
It may be noted that the deletion of L-T 
verbal scores from the regression analysis 
increased both the significance and mag- 
nitude of Davis-Eells Beta weight. 
Progressive Matrices correlated to a 
smaller degree with ITBS than did any of 
the other intelligence tests. It may also be 
seen that the L-T verbal test correlated 


a (N = 344) 

th | 848 51 = 

5.12 846 52 = 

7 5.24 844 53 = .683 

5.13 | 54 = .340 

5.34 | 695 

i 

a (N = 344) 

711 
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with every one of the ITBS subtests to a 
greater degree than did any of the other 
intelligence tests. The L-T nonverbal test 
correlated with every one of these subtests 
to a greater degree than did the Davis- 
Eells test. Moreover the latter correlated 
with every one of these subtests to a 
greater degree than did the Progressive 
Matrices. 

The analyses reported in this paper give 
little justification for the use of the Davis- 
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Eells Games, L-T nonverbal test, and the 
Progressive Matrices in conjunction with 
the L-T verbal test for general prediction 
purposes. This in no sense denies their use- 
fulness in individual diagnosis. In need of 
further exploration in particular is the 
significance of extreme discrepancies in 
performance on verbal and nonverbal in- 
telligence tests. 


Received October 28, 1958. 
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SOME BEHAVIORS OF ELEMENTARY SCHOOL CHILDREN 
RELATED TO CLASSROOM ACTIVITIES 
AND SUBJECT AREAS' 


SURANG KOWATRAKUL 
Chulalongkorn University 


In the field of educational psychology 
numerous questions concerning teaching- 
learning interaction have been awaiting 
empirical investigation. Many psycholo- 
gists agree that empirical studies in the 
classroom itself will prove useful in a vari- 
ety of ways. But this type of study when 
rigorously performed is rather difficult to 
accomplish because of several factors 
within the classroom situation. Further- 
more, several studies (American Council 
on Education, 1945; Anderson, 1937) have 
indicated that teachers need new tech- 
niques and methods for gathering informa- 
tion to aid them in obtaining new insights 
into their pupils’ behavior. 

Edueational psychology, — therefore, 
would seem to need reliable instruments 
or methods for measuring students’ be- 
haviors in the classroom as well as reli- 
able data which may form a solid founda- 
tion for the formulation of new concepts 
and the development of new theory. The 
aim of this study was to develop an in- 
strument for systematic observation of 


pupils’ behavior in what Sears has called 


a “naturalistic settings” situation (1957) 
and to make an empirical survey of the 
relationships of six categories of student 
behavior manifestations to three classroom 
activities and four subject areas. 


‘ Based on a dissertation done at the Lab- 
oratory of Human Development and sub- 
mitted to Stanford University as part of 
PhD requirements. Grateful acknowledge- 
ment is made to Pauline S. Sears, Quinn 
MeNemar, and Frederick J. McDonald for 
guidance and to Pra Chuang Kashetra, Thai 
Cultural Counselor, for securing financial 
aid for the research. 
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METHOD 
Definition of Behavior Categories 


Intent on Ongoing Work (IW) or dis- 
cussion, task oriented, performing assigned 
work. This category includes active work 
in assigned areas and also collecting, get- 
ting out, organizing, and putting away ma- 
terials necessary for work. The key phrase 
is task oriented. 

Social Work Oriented (SW): This cate- 
gory includes any social remark, inter- 
change, or action which is work oriented. 
For example, a child may initiate social 
contacts in relation to his own work, he 
may respond to another child’s work, he 
may explain a task to a peer, he may note 
another’s progress or show his own prog- 
ress, give or get suggestions in regard to 
work, or he may initiate interaction with 
a teacher in regard to a work problem. 
This category is reserved for the expres- 
sion of social needs in relation to work 
tasks. 

Social-Friendly (SF): This category in- 
cludes any social remark, interchange, or 
action. Within this category fall mutual 
horseplay, friendly conversation and ges- 
tures, and any funny faces or movements 
to attract others’ attention. The key words 
in this category are pure social interchange 
without task orientation to ongoing work. 

Momentary Withdrawal (MW): This 
category includes the behavior which oc- 
curs when an individual momentarily 
ceases his present task and wanders or 
looks around, watches others without ap- 
parent reason; or withdraws from class 
activity, appears unaware of the group, 
stares at a particular spot or into space, 
assumes an impassive expression and is 
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not, apparently, thinking about his work 
or engaging in social activity. 

Intent on Work in Another Academic 
Area (WOA): Tallies fall in this category 
when a student is doing some other aca- 
demic work than that which has been as- 
signed for the present period. 

Intent on Work in Nonacademic Area 
(WNA): This category is checked when a 
student is intent on activity of his own 
which is unrelated to academic work. This 
category also includes all complex play or 
doodling activity which is purposive or 
directed toward a consciously defined goal. 
For example, the student is making a pa- 
per airplane, or cleaning his desk, or ar- 
ranging a string or chain or paper clips 
into a certain figure. 


Definition of Classroom Activities 


Independent Seat Work: In this cate- 
gory, students are engaged in work in- 
dividually. Usually a student does an as- 
signed job which has a clearly defined goal. 

Watching and Listening: This category 
of classroom situation is employed when 
students are supposed to play a passive 
role. Examples: listening to the teacher, 
watching a demonstration, watching an 
educational program on TV. 

Discussion may be defined as symbolic 
interaction among three or more persons. 
Such interaction may be structured by a 
participating forma! leader, student or 
teacher; or it may take place within a 
structure prearranged by the teacher with 
a leader appointed by her; or it may be 
at a purely informal level following the 
bent of the participants. Discussion may 
be divided into small and large groups. 


Definition of Subject Areas 


Language is defined as any kind of work 
directed towards acquiring a proficiency 
in a manipulation of symbols (oral or writ- 
ten expression), their structuring, order- 
ing, construction, and pronunciation. Ex- 
amples include spelling, reading recrea- 
tional books, and writing or giving an oral 


report where emphasis is on successful 
communication rather than content. 

Arithmetic is defined as any work con- 
cerned with numbers and their relation- 
ships. 

Social Studies consists of work in human 
relations, civics, current events, history, 
news, and world events. 

Science consists of any study concerned 
with the principles of nature, facts of nat- 
ural phenomena, or methods of the bio- 
logical, physical, and social sciences. 


Sample 

56 children in Grades 5 and 6 of a small 
elementary school were observed. This 
number of Ss includes 15 boys in Grade 5 
and 18 in Grade 6, and 10 girls in the 
former class and 13 in the latter? 


Method of Gathering Data 


This study employed the point-time 
sampling technique in which an observer 
observes an S long enough to record one 
behavior, then passes on to the next S im- 
mediately. The behavior of the next S 
must be independent of that of the first in 
order to ensure independent behavior 
scores. Observations in this fashion con- 
tinue until one “behavior point” of each 
individual in the group has been recorded. 
Then a new round of observation begins. 
Observation experience indicated that each 
round took about four to five minutes in 
the sixth grade class and about three to 
four minutes in the fifth grade class. 

For efficiency and preciseness in record- 
ing, observation record sheets were pre- 
pared prior to the time of gathering data. 
The observer also described in detail the 
nature of the classroom activity at the 
time of observation. Data were recorded 


* Although sex differences are likely for 
some of the six behaviors defined above, 
analyses separately for the sexes were not 
contemplated because of consequent small 
Ns and because the emphasis is on behaviors 
of a class as a whole. The results, therefore, 
cannot safely be generalized to sex segre- 
gated classes. 
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only when classes were engaged in the par- 
ticular activities defined above. No record- 
ings were made during intervals of tran- 
sition from one activity to the next. 
Sometimes classroom activities were di- 
versified in which case behavior frequen- 
cies were not recorded. Data were not col- 
lected when a substitute teacher replaced 
the regular one. 

Further, because this study was a “natu- 
ralistic settings” type, the observer tried 
not to interfere with the plan of the class. 
The observer also attempted to reduce 
any halo effect which might arise from her 
subjective impressions of the pupils. Dur- 
ing the time of collecting data she tried to 
avoid contact with individual pupils. 

Table 1 presents the mean number of 
time samples per student under each class- 
room activity and subject area in each 
grade. The total number of time samples 
was 45,526. 


Scoring and Reliability 


For reasons beyond the control of the 
experimenter the number of time samples 
(or observations) was not constant for all 
students, hence it was necessary to use a 
percentage scoring system. Thus, eg., a 
score of a student for the IW category is 


123 


TABLE 1 
Mean Noumser (Per Stupent) or Time 
SaMPLES FOR THREE CLASSROOM 
ACTIVITIES AND Four Sussect 
AREAS 


(Ns: Grade 6, 31; Grade 5, 25) 


Subject Area 


Classroom activity 


Independent 
Seat Work 

Watching- 
Listening 

Discussion 


61 


the number of behaviors judged as IW 
relative to the total number of observa- 
tions on that student under a specified 
condition (such as Arithmetic-Discussion) . 
For each student there were 12 scores (cor- 
responding to the 12 combinations of con- 
ditions) for each of the six behavior cate- 
gories. 

Score reliability was ascertained by cor- 
relating percentage scores for odd-num- 
bered vs. even-numbered time samples. 
Since the 30 computed Spearman-Brown 
coefficients (Table 2) were generally high, 


TABLE 2 


SpeEARMAN-Brown RELIABILITIES OF BEHAVIOR SCORE 


Behavior Categories 


Classroom Activity | Subject Area 


Iw | sw | sF | MW | woa | WNA 


Watching- Science 
Listening 
Independent 

Seat Work 


Discussion 


| Language 


984 


Social Studies | .941 


Grade 5 


953 


928 


Grade 6 


Independent Arithmetic 
Seat Work 


Discussion Science 


-957 


=. 

| 

6 | 65| 60 | 66 | 

ib 5 | 82| 68 | 63 | 89 

6|118| 77 | 61 | 62 

ae 5 | 62| 62 | 55 | 61 

et 6 65 65 64 51 

5 | 59| | 62 | 58 

q 
982 | .986 | 956 | .970 | 894 .985 
| 960 | .984 | .960 
943 | .994 | | 905 | .875 | .988 
— 
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it seemed unnecessary to determine all of 
the possible 144 reliability coefficients. 
Many of the computed reliabilities are 
sufficiently high to suggest that adequate 
reliability could be attained with fewer ob- 
servations. 

Perhaps, in the light of the given reli- 
abilities, it is not necessary to report that 
the preliminary question of observer re- 
liability received a satisfactory answer. 
Data were collected over a period of five 
days by a trained observer (M. H. Pintler 
of the Laboratory of Human Develop- 
ment) and the writer. These two observers 
simultaneously fixated upon the same stu- 
dent, with identical observation times en- 
sured by the use of signals. Following the 
signal, the behavior of a student was im- 
mediately observed, categorized, and re- 
corded independently by the two observ- 
ers. For a total of 1,689 time samples, with 
data combined for different classroom ac- 
tivities and subject areas, there was 94% 
agreement in the categorizing. This figure 


TABLE 3 
MEANS FOR INTENT ON ONGOING WorK 
(IW) Unper Taree CLassroom 
ACTIVITIES AND Four SusBJect 
AREAS 
(Grade 6 top half; Grade 5 bottom half) 


Independent (76.07 #2. 6478. 16.77.75 
Seat Work 

Watching- 
Listening 

Discussion 


73. 5571. 77/73. 35 76. 39 73.77 


52.42 53.45 52. 7158. 9453. 88 
| | 
Mean of 
Means 67 .34 69.29 68.06 69.16 68.47 


Independent 82. 9281.48 79. 68 80. 29 
Seat Work 

Watching- 
Listening 

Discussion 


12 84. 8074. 1079 28/80. 15 


152. 56 56.00 46. $8 53. 24.52.12 
| 


72. 47/74. 09/6. 79/70. 07 70. 85 


Mean of 
Means. 
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is sufficiently high to indicate that the 
data collected by a single observer could 
be replicated by another observer. 


ANALYSES OF DaTa AND FINDINGS 


It was stated in the presentation of the 
method of gathering data that the fre- 
quencies for the occurrence of each type 
of behavior (Intent on Ongoing Work, So- 
cial Work, Social-Friendly, Momentary 
Withdrawal, Intent on Work in Another 
Academic Area, Intent on Work in Non- 
academic Area) of each child were col- 
lected under each condition of three class- 
room activities (Independent Seat Work, 
Watching-Listening, and Discussion) and 
four subject areas (Science, Social Studies, 
Arithmetic, and Language). The design is 
such that tests of significance involve a 
three-way analysis of variance, separately 
for each grade, with rows representing in- 
dividuals, columns representing the four 
subject areas, and blocks representing 
three kinds of classroom activities. This 
type of analysis was made for each de- 
pendent variable except Intent on Work 
in Another Academic Area for which the 
distributions were highly skewed. 

With I standing for Individuals, S for 
Subject Areas, and A for Classroom Ac- 
tivity, the main effect for S was tested 
against the I x S interaction, the A ef- 
fect against the I x A interaction, and the 
S x A interaction against the I x Sx A 
interaction. Because of space limitations 
the usual analysis of variance tables, 10 in 
number, will not be presented. Instead, 
tables of means will be given, with the re- 
sults for Grades 5 and 6 in the top and 
bottom halves, respectively. The statisti- 
cal significance of the comparisons will 
next be briefly summarized. 

For Intent on Ongoing Work (see Table 
3) the Activities (A) effect is significant 
beyond the .0005 level for both grade 
groups, with markedly lower IW during 
Discussion. The Subject Area (S) effect is 
significant (.0005 level) for Grade 5, but 
insignificant for Grade 6. The A x S in- 
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TABLE 4 
_ Means FOR SociaL WorkK (SW) 


| Mean of || 
Means || 


Independent 6.94) 2 5.55) 7.16 
Seat Work 

Watching- 
Listening 


Discussion 


3.68) 9. 19 a 19 6.86 

2.1612.74 28. 3921. 73 

7.78 15.03 12.0411.91 


Mean of 
Means 2.80 


Independent .20 10.44 10.20 9.84) 9.92 
Seat Work 

Watching- 5.68 
Listening 

Discussion 


4.88 17.52 9.75 


2426. 36 32. 00/33. 23 


Mean of 


Means 5.71)13.88 23.69 17. 25, 17.63 


teraction reached the .005 level for Grade 
6, but was not significant for Grade 5. 

For the SW variable (Table 4) both 
main effects and their interaction are 
highly significant (beyond .0005 level) for 
both grade groups. High SW occurs con- 
sistently (despite the A X S interaction) 
during Discussion, but the high SW for 
Arithmetic compared to low for Social 
Studies needs to be qualified because of the 
A &X § interaction. 

The Social-Friendly beh: ivior (Table 5) 
yielded significant A S interaction (be- 
yond the .001 level for both grades), with 
insignificant S effect for Grade 5, and only 
05 level of significance for Grade 6. The 
A effect was borderline in significance (.03 
level for both grades). The main effects 
are overshadowed by the interactive effect. 

The only significant effect for MW (Ta- 
ble 6) is the A X S interaction for Grade 
6 (.0005 level). 

For behavior defined as Work in Non- 
academic Area (Table 7), all three effects 
for the sixth grade group were significant 
beyond the .001 level as were also the A 
and the A X § effects for Grade 5, with 
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TABLE 5 
MEans | FOR R Soctau- FRIENDLY (SF) 


Social 
Studies 
Arithmetic 


Independent Seat 6. 4.71/5.558. 
Work | 

atching- Listen- 16 5. 74'5. 105.03 
ing 

Discussion 6.52 10.97 5.07|5.35 6.98 

| 

| | 

Mean of 
Means 5.94 


Seat 2. 60 
Work 

Watching-Listen- 
ing 

Discussion 


7.145.256.096.10 


2.842 


2.84 2.44 3.681.72 2.67 
3.48) 4.765.32 2.403.99 
Mean of 

Means 2.97| 3.35'3.76 2.77'3.21 


TABLE 6 


Means FOR MoMENTARY WITHDRAWAL 
(MW) 


Science 
Social 
Studies 
Arithmetic 
Language 
Mean of 
Means 


Independent Seat 
Work 

Watching-Listen- 
ing 

Discussion 


4.77 3.07 4.686.714. 
'4.076.71 4.13 4.584.8 


Mean of Means. .|4.665.42 4.425.064. 
Independent Seat 
Work | 
Watching-Listen- (2.28 
ing 
Discussion 


2.00 3.56 3.12:2.93 
2.20 1.60 2.52 2.20 


2.72 3.56 2.24 4.60 3.28 


Mean of Means. . 2.68 2.59 2.53 3.41 2.80 


the 8 effect for the latter group reaching 
only the .03 level. 

As mentioned earlier the distributions 
of the scores of Intent on Work in Another 
Academic Area (WOA) were highly 
skewed. Cochran’s Q formula (McNemar, 
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TABLE 7 


Means FoR INTENT ON WorK 
ACADEMIC AREA (WNA) 


In Non- 


Arithmetic 


| 


Independent 3.10) 2.36 
Seat Work 

Watching- 
Listening 


Discussion 


7.16 


| 
11.45)13.06 8.06 6 .87/9.86 


| 


Mean of Means .| 7.24 


Independent 1.16) 
Seat Work = 
Watching- 4.40 3.96 2.24.3.723.58 
Listening | 
Discussion 8.04 
4.49 2.37/4.35)3.94 


Mean of Means 4.53 


p. 232) was employed to analyze these 
scores. Cochran’s technique as here used 
is an extension of the nonparametric “me- 
dian” test to the situation involving cor- 
related scores. This method does not per- 
mit a test of the A x 8 interaction. The S 
effect was significant at the .01 and .02 
levels for the sixth and fifth grades, re- 
spectively. The A effect was significant at 
the .001 level for Grade 6, but insignificant 
for Grade 5. The percentages exceeding the 
appropriate medians are given in Table 8, 


TABLE 8 
INTENT ON WoRK IN ANOTHER ACADEMIC 
Area (WOA)—PeERcENTAGES EXcEED- 
ING MEDIAN VALUES 


Conditions 


Science 

Social Studies 
Arithmetic 
Language 


Independent Seat Work 
Watching-Listening 
Discussion 
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from which it will be noted that there was 
less WOA during Arithmetic and during 
Independent Seat Work. 

No comparisons were made for any of 
the behavior scores between the two grades 
because such differences as were obtained 
are possibly confounded with a teacher 
effect. Incidentally, the magnitudes of the 
over-all means in Tables 3-7 are indicative 
of the relative amounts of the several cate- 
gories of behavior. Thus about 70% of the 
behavior during the observation times was 
Intent on Ongoing Work, with about 12% 
and 18% for the sixth and fifth grades, re- 
spectively, being Social Work. The per- 
centages for the other categories are rela- 
tively small and homogeneous. 


DiscussiON AND INTERPRETATION 


We may conveniently group the six 
students’ behavior manifestations into two 
categories with respect to the kind of 
teacher response they evoke: teacher-ap- 
proved and teacher-disapproved. In the 
first of these groups fall the behaviors 
which were called Intent on Ongoing Work 
and Social Work. These two types of be- 
havior were reinforced by teachers who 
often gave verbal approval to students 
who manifested them. The second group, 
Teacher-Disapproved behavior, includes 
the Social-Friendly, Intent on Work in An- 
other Academic Area, Intent on Work in 
Nonacademic Area, and, perhaps, Momen- 
tary Withdrawal. As indicated in the just 
previous paragraph, over 80% of the ob- 
served behavior fell in the teacher-ap- 
proved category. 


Effect of Classroom Activities 


Does the particular nature of each class- 
room activity influence behavior? If one 
compares the means of the means of Intent 
on Ongoing Work behavior for classroom 
activities, it will be seen that the highest 
means are for Independent Seat Work and 
Watching-Listening for both classes. It 
would seem that Discussion activity is less 
conducive to this type of desirable or 
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teacher-approved behavior, whereas Dis- 
cussion is favorable to Social Work behav- 
ior (Table 4). The high scores in Intent 
on Ongoing Work behavior in Independent 
Seat Work and Watching-Listening can be 
related to the nature of the activities 
themselves. In the activity called Inde- 
pendent Seat Work usually there were 
pressures for individually intensive work. 
For example, this activity involves tasks 
which must be completed within a certain 
time limit, research for individual reports, 
and creative writing—on which teachers 
base in part their evaluations. The high 
IW means for the Watching-Listening ac- 
tivity can be explained by the nature of 
this type of activity and tasks: usually 
students were required to take notes and 
listen carefully. The teacher often asked 
the class questions at the end of the ac- 
tivity. Further, Watching-Listening fre- 
quently aroused students’ interest because 
of some novelty as exemplified by motion 
pictures, television productions, and guest 
speakers. 

The relatively higher Social Work means 
for Discussion are related to the purpose of 
this activity which satisfies a social need 
for interpersonal interaction and exchange 
of ideas. 

If we examine the means of the means 
(Table 7) of the category Intent on Work 
in Nonacademic Area for classroom ac- 
tivities, we see that in both classes the 
maximum values of the means of the 
means were in the Discussion activity. The 
results might seem to indicate the possibil- 
ity that the Discussion has two character- 
istics: among students who have more self- 
confidence the discussion period may 
provide an opportunity to participate ac- 


tively in talking and exchanging ideas;° 


among more self-conscious students the 
discussion period is largely a time of 
watching and listening activity. Since these 
students were only listening, their hands 
were not engaged in taking notes; some- 
times they drew pictures or figures. 

The differences between the means of 
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the means of Intent on Work in Non- 
academic Area in Watching-Listening and 
Independent Seat Work activities were 
significant for both grades, with higher 
scores found in Watching-Listening ac- 
tivity. This finding again can be explained 
in terms of our previous analysis of the 
nature of the Watching-Listening activity, 
ie., during the period students were not 
taking notes, they could engage in other 
activities such as playing with their pen- 
cils, erasers, or paper clips. 

Any conjecture about the relatively 
small effect of Activity on the Social- 
Friendly behavior will need qualification 
because of the marked A x S§ interaction. 
It is not surprising that Independent Seat 
Work provides an opportunity for more 
Work in Another Academic Area. 


Behavior Related to Subject Areas 


For Grade 6, the over-all test for the 
main effect of Subject Area on the be- 
havior Intent on Ongoing Work was in- 
significant, but in Grade 5 Subject Area 
had an effect. This contrast may reflect 
either teacher differences or a true grade 
effect. 

For both grades the highest value of the 
mean of the means of Social Work be- 
havior was for Arithmetic (Table 4), with 
the lowest in Social Studies. These results 
may derive in part from the relatively high 
degree of questioning both by the teachers 
and by students requesting help, during 
Arithmetic with fewer questions during 
Social Studies. It should be noted that it 
was not feasible to include in the research 
design the classroom activity, working in 
small groups, which was used much during 
Social Studies and which would be con- 
ducive to SW. Any further speculating 
about the effect of Subject Area on SW 
should consider the fact of A x S inter- 
action. 

Since the main effect of Subject Areas 
on Social-Friendly behavior was insignifi- 
cant for Grade 5 and reached only the .05 
level for Grade 6, and since the A x § 
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interaction was highly significant for both 
grades, any interpretation of the difference 
between the means of the means becomes 
precarious. Note in the top half of Table 
5 that under Social Studies we have the 
highest mean (10.97) of the row for Dis- 
cussion but the lowest (4.71) in the row 
for Independent Seat Work. Similarly, 
note the 4.20 and 1.72 in the bottom half 
of the table—Language leads to most SF 
in one, and least in another, Activity. 

With regard to the differences in Intent 
on Work in Nonacademie Area associated 
with Subject Areas, it is interesting to note 
that the lowest value of the mean of the 
means for Grade 5 was under Arithmetic 
while in Grade 6 the means of the means 
were lowest for Arithmetic and Language. 
Once again, the presence of A X 8 inter- 
action cannot be ignored when considering 
the S effect. 

The effect of Subject area on WOA (see 
Table 8) indicates less WOA under Arith- 
metic. Apparently, Arithmetic was handled 
by these teachers so as to lead to less 
teacher-disapproved behavior. 


SuMMARY 


This study was an investigation of the 
relationships of six behaviors manifested 
by 56 elementary school children (fifth 
and sixth graders) to three classroom ac- 
tivities and four subject areas. The find- 
ings demonstrated that classroom activities 


and subject areas and some of the behavior 
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categories observed are significantly re- 
lated. 

From the findings of this study one may 
not legitimately infer that the behavior of 
all sixth and fifth graders will replicate 
the patterns uncovered here. This study 
did not have as its purpose any attempt to 
draw generalizations for a population but 
rather hoped to unfold some suggested re- 
lationships among classroom activity, sub- 
ject area, and students’ behavior mani- 
festations which may on more exhaustive 
investigation prove useful in the formula- 
tion of a consistent theoretical framework. 

A secondary purpose for this study was 
that of developing a reliable instrument for 
measurement of children’s behavior which 
might be applied in classrooms. This was 
accomplished. 
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REFUSALS AND ILLEGIBILITIES IN THE SPELLING ERRORS 
OF MALADJUSTED CHILDREN! 


HARRY H. L. KITANO 
University of California, Los Angeles 


Disability in subject matter areas, such 
as reading and spelling, have been a major 
target for research. For example, Gates 
and Russell (1940) have attempted to 
hypothesize emotional difficulties as pos- 
sible causes for reading and spelling fail- 
ures. Bower (1958) has shown that ad- 
justment-class children (also known as 
emotionally disturbed and behavior-prob- 
lem children) score significantly lower than 
regular-class children in reading, arithme- 
tic, and other subject matter areas. The 
purpose of this paper is to study the quan- 
titative and qualitative errors in spelling 
between regular- and adjustment-class 
children. 

Logically, it appears that adjustment- 
class children should make more errors 
and different types of errors than their 
regular-class counterparts. Their overall 
poor adjustment in school (Bower, 1958), 
lower reading ability (Bower, 1958), and 
other related factors indicate poorer spell- 
ing achievement. These, plus their higher 
anxiety and rigidity (Kitano, 1958) and 
poorer ego controls (Kitano, 1958) suggest 
the following hypotheses: (a) that adjust- 
ment-class children will be poorer spellers 
than regular-class children; (6) that ad- 
justment-class children will make different 
types of errors than regular-class children. 


Definitions, Sample, and Delimitations 


Adjustment classes are set up for be- 
havior-problem children in the San Fran- 
cisco Unified School District. The children 
are often referred to as the “emotionally 


*The research was made possible through 
the valuable cooperation of Margaret Hol- 
land, Supervisor of Elementary Guidance; 
Clara Moore, Principal; and the adjustment 
class teachers of the San Francisco Unified 
School District. 


disturbed”; the common underlying symp- 
tom is the inability to get along in a regu- 
lar class assignment. The classes are set 
up for children who have normal intellec- 
tual potential. 

The regular-class children in the study 
were drawn from one school in a lower- 
middle class area. This roughly corre- 
sponds to the socioeconomic status of the 
adjustment-class group as reported in a 
previous study (Kitano, 1958). The princi- 
pal of this school describes her children as 
being from “fair to poor” in spelling 
achievement and reports the mean IQ to 
be around 95. This again roughly corre- 
sponds to the IQ level of the adjustment- 
class group (Kitano, 1958). Therefore, an 
attempt was made to match the groups in 
regard to socioeconomic status and IQ 
through this selection procedure. 

The sample consisted of all the fourth, 
fifth, and sixth grade children from the 
regular-class group of one school and all 
the fourth, fifth, and sixth grade children 
in the adjustment classes. The number in 
each group was 88; the sample consisted 
of 176 children. 

The spelling words were chosen from 
Gates’ A List of Spelling Difficulties in 
3876 Words (1937). Twenty words classi- 
fied by Gates as being between the 4.6 and 
4.9 grade levels were chosen as it was be- 
lieved that these words would be familiar, 
yet difficult enough for fourth, fifth, and 
sixth grade children. 

In a paper devoted to spelling errors, 
the delimitation of the method of classifica- 
tion of such errors is of utmost importance. 
Spache (1940) reviews the various classifi- 


cations and suggests various criteria which 
must be met in order to analyze spelling 
errors. The method of classification used in 
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this research is a combination of the 
Spache (1940) and Gates and Russell 
(1940) classifications, modified for the ex- 
ploration of the hypotheses under investi- 
gation. The six types of errors and classi- 
fications are listed below: 

Additions and insertions, such as sticke 

for stick 

Omissions, such as fether for feather 

Phonetic errors, such wate for wait 

Substitutions and reversals 

Words refused or not completed 

Unrecognizable 


Procedure 


All testing was done in December of 
1957. The writer gave the spelling test to 
the regular-class children; the individual 
adjustment-class teachers gave the test to 
their own classes. 

Coding of the spelling errors was done 
by the experimenter. 

A comparison of the type of errors was 
made by group, and statistical significance 
was tested through chi square. 


RESULTS 


The summary of findings is presented in 
Table 1. The regular-class children made 
significantly more errors in additions, pho- 


TABLE 1 


COMPARISON AND SIGNIFICANCE OF TOTAL 
Errors BY Groups IN ADDITIONS, 
Omissions, PHonics, SuBstitTu- 
TIONS, Worps REFUSED, AND 
UNRECOGNIZABLE SPELLING 


Adjust- 
| “ment. | Reguiar- 
Class 


| Errors Errors 


Additions 70 
Omissions 80 
Phonics | 70 
Substitutions | 161 


Words Refused | 616 
Unrecognizable | 312 


Cases | 
Spelling | 20 
Words 


* Significant at .0! level. 
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netics, and substitutions. The adjustment- 
class children made significantly more er- 
rors through refusals and unrecognizable 
spelling. There was no significant difference 
between the groups in omissions. 

The regular-class children scored sig- 
nificantly higher on the number of words 
correct. Of the total number of attempted 
and legible words, the adjustment-class 
children missed 52.7%; the regular-class 
children 17.6%. 


Discussion 


Causes of spelling errors have been clas- 
sified into three broad categories by Cole 
(1936), and Gates and Russell (1940). 
The errors include (a) deficiencies within 
the pupil, (b) difficulties inherent in the 
English language, and (c) inappropriate 
methods of teaching. 

The errors under the first two categories 
were explored in the present study. There 
was no attempt to control or analyze 
teaching methods. 

It is possible to think of errors in addi- 
tions, omissions, phonetics, and substitu- 
tions as being errors primarily due to the 
difficulty of the English language, or ex- 
ternal errors. It is of interest to note that 
the regular-class children made more ex- 
ternal errors than adjustment-class chil- 
dren. 

The type a errors, or difficulties within 
the pupil, manifest themselves in errors 
due to “refusals” and “unrecognizable 
spelling.” Something within the child 
makes it impossible for the child to try 
writing the word or to come up with some- 
thing completely unrecognizable when he 
does write. It is suggested that the higher 
anxiety of the adjustment-class child (Ki- 
tano, 1958) is one reason for the “refusals” 
and the unrecognizable spelling. The find- 
ings appear to confirm an earlier study by 
the author (Kitano, 1958) in which ad- 
justment-class children were found to have 
significantly higher anxiety and rigidity 
scores than regular-class children. Higher . 
anxious and higher rigid children should 
be characterized by a refusal to try some- 
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thing new—in this case spelling words— 
while children with less anxiety and rigid- 
ity should feel relatively free to try. 

In effect, the high anxiety blocks learn- 
ing, the high rigidity channels the anxiety 
into a refusal to attempt or try words, and 
the rigidity and the refusal to try evidently 
creates more anxiety. This vicious circle in 
one specific subject matter area is no doubt 
repeated over and over again in school and 
is one probable cause for much of the 
discharge of anxiety by adjustment-class 
children through extremely hostile, ag- 
gressive behavior. 

It is evident that the role of a teacher 
in an adjustment class is to somehow al- 
leviate some of the excessive anxiety, per- 
haps by giving praise to those who try, no 
matter what the result, and to minimize 
the competitiveness of the normal spelling 
lesson. Success at a lower level, such as 
reduced spelling load, longer time intervals 
for learning, and the minimization of the 
formalized spelling test can be of pos- 
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sible value towards alleviating some of the 
anxiety producing situations. 
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PERSONALITY AND INDEPENDENT STUDY’? 


KATHRYN KOENIG anv W. J. MCKEACHIE 
University of Michigan 


Does it make any difference how we 
teach? Despite a number of carefully 
executed studies on the comparative ef- 
fectiveness of various teaching methods, 
there is little evidence to support the view 
that one teaching method is more effec- 
tive than any other. 

At the moment, our University of Mich- 
igan project is most vitally concerned with 
one explanation of the finding that there 
is little difference in the jerformance of 
students taught by one method as com- 
pared to other methods. Our assumption 
is this: “Any teaching method is effective 
only for certain students; when we com- 
pare teaching methods on group measures, 
the effects upon different students cancel 
each other out.” 

In this study we hypothesized that the 
highly independent students would prefer 
learning, perform better, and be more in- 
volved in an independent study situation. 
Likewise, we hypothesized that students 
with high need for affiliation would prefer, 
perform better, and be more involved in 
small group discussions than would other 
students. Finally, we hypothesized that 
students high in n Achievement would do 
well in independent study. 


DesIGN OF THE EXPERIMENT 


The experimental groups consisted of 
124 students (89 females, 35 males) who 
were enrolled in a single lecture section of 
an elementary psychology course which 
met twice weekly. The students also met 


*This study was part of a larger study 
supported by a grant from the Ford Fund 
for Advancement of Education. Substantial 
portions of this paper were presented in a 
symposium, “Experimental Studies in Learn- 
ing Independently,” at the 1958 APA meet- 
ings. 


twice weekly in six discussion sections of 
about 20 students each” 

In order to test our hypotheses we ma- 
nipulated the teaching methods in these 
sections experimentally so that during the 
semester each student would participate 
in small group discussions and independent 
study in lieu of the regular discussion 
classes. In order to achieve this, the regu- 
lar discussion sections were discontinued 
for two weeks and each student in one half 
of the class wrote a paper independently, 
while students in the other half met in 
small groups. Later in the semester, the 
experimental procedure was repeated with 
the groups reversed so that each student 
participated in both variations of teaching 
method. 

Students in the lecture group took the 
following measures of personality: The 
California Psychological Inventory, which 
gave scores on 18 traits; Stott’s inventory, 
Every-day Life, which yielded three meas- 
ures of self-reliance; and finally the The- 
matic Apperception Test, as modified by 
McClelland, which was scored for Need for 
Achievement, Need for Power, and Need 
for Affiliation. In addition, observers re- 
corded the interaction in the small group 
discussions, using our modified Bales re- 
cording system.’ 

Measures of the students’ preferences, 
involvement, and performance were ad- 
ministered after each variation of teaching 
and at the end of the semester. Students 
were asked to rate the importance of the 
teaching method and the effectiveness of 
the method. In addition the student indi- 


*The cooperation of the discussion lead- 
ers, Myron Braunstein, Nathan Brody, and 
Sarah Curtis is greatly appreciated. 

* Richard Mann devised the categorization 
system used and trained our observers. 
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cated which method he preferred and how 
involved he was in that portion of the 
course. The instructors evaluated the stu- 
dents’ performance in the small groups, on 
the paper, and in the total course. 


RESULTS AND DiscussIoN 

Since previous studies had indicated that 
different results may occur for men and 
women, the analyses were done separately 
for each group. In general, the personality 
variables were used as independent vari- 
ables; and the ratings, grades, and ob- 
servation records were used as dependent 
measures. 

The first analysis of the data was dis- 
appointing. The two major hypotheses 
were not supported. The measures of self- 
reliance or of n Affiliation were not related 
to satisfaction, performance, or involve- 
ment in the experimental groups. 

When we looked at n Achievement, our 
results were a little more encouraging. Al- 
though there were no significant differ- 
ences for men, high n Achievement women 
preferred the innovations (both small 
group and independent study sessions) to 
lectures. The middle n Achievement 
women, on the other hand, preferred lec- 
tures. Previous studies have indicated that 
middle n Achievement people are high in 
fear of failure and thus may wish to avoid 
the more threatening independent study 
and small group procedures because they 
demand new skills which they are not sure 
of. High n Achievement women, on the 
other hand, may find these innovations 
more challenging than the usual lecture 
sections. 

Some of our peripheral results still puz- 
zle us. For example we found some sur- 
prising sex differences. High n Power 
women participate less in the small groups 
than do low n Power. However, the direc- 
tion of this relationship is reversed with 
men. 

The trait of flexibility is even more puz- 
zling. It is related to participation in the 
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TABLE 1 


RELATIONSHIP BETWEEN WoMEN’s 
FOR ACHIEVEMENT AND TEACHING 
METHOD PREFERENCES 


Preference for Method 


Need 
Achievement | 
(Women) | Lecture | Small | Inde- 
| Group | pendent 
High 2 | 8 5 
Mid | 6 | 4 3° 
Low 7 7 6> 


*Chi equare = 12.6. 
> Probability = .05. 


TABLE 2 


RELATIONSHIP BETWEEN WoMEN’s NEED 
FOR POWER AND AMOUNT OF ParRTICI- 
PATION IN SMALL Group Discussions 


Need Power Amount of Participation 
(Women) 

High Low 

High 9 ome 

Mid 

Low 14 7 
*Chiequre= 71. 
> Probability = .05. 
TABLE 3 


A COMPARISON OF THE PARTICIPATION OF 
Hich Neep Power anv HicH 
Power WoMEN IN THE 
SMALL Groups 


High Need Power 


| High Low 
Men 10 2" 
Women | 10 23> 


* Chi square = 10.0. 
> Probability = .001. 


small groups. This CPI scale has a high 
negative correlation with the California F 
(Authoritarian) Scale, and it is not sur- 
prising that the flexible nonauthoritarian 
individual should participate freely in the 
rather permissive small groups. This is 
what we find for women. For men, how- 
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ever, this scale predicts in the opposite 
direction. Highly flexible men are signifi- 
cantly less likely to participate than men 
low in flexibility. 

Despite the number of negative results, 
this study provides some encouragement 
for continuing examination of individual 
differences with teaching methods. Our 
measures of need for power and of flexi- 
bility do predict participation in permis- 
sive small groups, albeit in odd ways. We 
once again found evidence that students 
who fear failure prefer familiar well-struc- 
tured situations such as lectures, and we 
once again found sex differences even 
though we cannot explain them. 

Some additional results maintain our 
feeling that programs of independent study 
need to take account of personality. Carle- 
ton College also participated in the Ford 
Fund studies of independent work.‘ 64 of 
their seniors took one of several independ- 
ent study courses last fall semester. There 
were no control groups, but the students 
did take the CPI, Allport-Vernon, and a 
scale developed at Michigan to measure 
students’ conception of the teacher’s role. 

While the Allport-Vernon and CPI failed 
to predict performance in independent 
study, our Michigan scale did. Students 
who think the instructor should be au- 
thoritarian tended to do poorly in inde- 
pendent study. However, this measure does 
not relate significantly to over-all grades 
in other college courses or to intelligence. 


SuMMARY AND CONCLUSIONS 


Each student of an introductory psy- 
chology course participated in small group 
discussions, independent study, and regular 
lecture - discussion sections. Personality 
data and measures of the students’ prefer- 
ences and performance under each method 
were collected. Neither the measures of 
self-reliance nor of n Affiliation were re- 
lated to satisfaction, performance, or in- 
volvement in the small group discussions, 

* Jean Calloway directed the Carleton Col- 
lege study. Rae and Steven Kaplan carried 
out this analysis. 
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or independent study. However, high n 
Achievement women preferred the two 
innovations to lectures, while middle n 
Achievement women preferred the lecture 
method. Additional findings were that high 
n Power women participated less in the 
small groups than low n Power women; 
whereas the direction of the relationship 
was reversed for men. Similarly, the non- 
authoritarian women participated more in 
the small groups, while the nonauthori- 
tarian man was less likely to participate 
in the permissive discussions. 

A second study at Carleton College 
showed that students who think the in- 
structor should be authoritarian tended to 
do poorly in independent study. 

Although the present study utilizing the 
approach of method-individual interac- 
tions does not represent a major break- 
through, our ability tentatively to explain 
negative results coupled with the positive 
results we have so far achieved are en- 
couraging. The teaching-learning process 
is a very complex one—one which can be 
mastered only through research designs 
permitting the study of teacher-group in- 
teractions as well as method-student inter- 
actions. Perhaps there is some virtue in the 
current college enrollment boom, for multi- 
variate designs require Ns much larger 
than any we have used to date. 

Even with more definitive results, how- 
ever, we would not conclude that students 
with certain types of personality should be 
excluded from independent study or small 
group discussions. As we see it, our goal 
should be for all students to learn to work 
independently and to participate responsi- 
bly in small groups. Rather than excluding 
students who dislike independence or work 
in small groups from these classes, we may 
want to give them special training and at- 
tention in order to help them learn how to 
learn in these situations. Increased knowl- 
edge about student personalities should 
give us increased ability to achieve these 
goals. 
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